-- Logs begin at Tue 2022-02-15 13:44:27 UTC, end at Tue 2022-02-15 14:45:23 UTC. -- Feb 15 14:15:27.866145 dv-cinder-819149-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 15 14:15:27.874880 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 15 14:15:27.877568 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Feb 15 14:15:27 2022] *** Feb 15 14:15:27.877568 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 15 14:15:27.877568 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 15 14:15:27.877568 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: nodename: dv-cinder-819149-3-iscsi Feb 15 14:15:27.877568 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: machine: x86_64 Feb 15 14:15:27.877568 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: clock source: unix Feb 15 14:15:27.877568 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: pcre jit disabled Feb 15 14:15:27.877568 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: detected number of CPU cores: 4 Feb 15 14:15:27.877568 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: current working directory: / Feb 15 14:15:27.877568 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: detected binary path: /usr/bin/uwsgi-core Feb 15 14:15:27.877568 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: your processes number limit is 47680 Feb 15 14:15:27.878338 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: your memory page size is 4096 bytes Feb 15 14:15:27.878338 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: detected max file descriptor number: 2048 Feb 15 14:15:27.878338 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: lock engine: pthread robust mutexes Feb 15 14:15:27.878338 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: thunder lock: enabled Feb 15 14:15:27.878338 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 15 14:15:27.878338 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 15 14:15:27.923934 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: Python main interpreter initialized at 0x56460e0cd9c0 Feb 15 14:15:27.923934 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: python threads support enabled Feb 15 14:15:27.923934 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: your server socket listen backlog is limited to 100 connections Feb 15 14:15:27.923934 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: your mercy for graceful operations on workers is 90 seconds Feb 15 14:15:27.924269 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: mapped 403077 bytes (393 KB) for 2 cores Feb 15 14:15:27.924380 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: *** Operational MODE: preforking *** Feb 15 14:15:27.924650 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: *** uWSGI is running in multiple interpreter mode *** Feb 15 14:15:27.924650 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: spawned uWSGI master process (pid: 101916) Feb 15 14:15:27.924849 dv-cinder-819149-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 15 14:15:27.925946 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: spawned uWSGI worker 1 (pid: 101917, cores: 1) Feb 15 14:15:27.925946 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: spawned uWSGI worker 2 (pid: 101918, cores: 1) Feb 15 14:15:27.925946 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 15 14:15:29.760599 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 14:15:29.760599 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: from cryptography.utils import int_from_bytes Feb 15 14:15:29.761237 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 14:15:29.761237 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: from cryptography.utils import int_from_bytes Feb 15 14:15:29.761426 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 14:15:29.761426 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: from cryptography.utils import int_from_bytes Feb 15 14:15:29.761904 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 14:15:29.761904 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: from cryptography.utils import int_from_bytes Feb 15 14:15:32.386595 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 15 14:15:32.387110 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 15 14:15:32.387196 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 15 14:15:32.387548 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 15 14:15:32.387630 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 15 14:15:32.387706 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 15 14:15:32.387952 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 15 14:15:32.388054 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 15 14:15:32.388205 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 15 14:15:32.388293 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 15 14:15:32.388609 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.388698 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.388933 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.389027 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.389250 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.389343 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.389564 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.389656 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.389898 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.390034 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.390206 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.390318 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.390522 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.390622 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.390838 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.390931 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.391684 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.391863 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.392054 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.392148 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.392391 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.392556 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.392731 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-3-iscsi {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.392817 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-3-iscsi {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.393054 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.393140 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.393360 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.393453 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.393671 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.393756 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.393989 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.394072 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.394293 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.394390 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.394615 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.394710 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.394918 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.395008 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.395411 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.395519 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.395841 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.395960 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.396141 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.396260 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.396471 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.396605 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.396806 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.396925 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.397118 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.397287 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.397424 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.397508 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.397740 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.397823 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.398046 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.398137 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.398365 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.398498 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.398670 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.398761 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.399058 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-3-iscsi {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.399156 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-3-iscsi {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.399371 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.399466 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.399679 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.399763 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.399990 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.400111 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.400414 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.400528 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.400726 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.400880 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.401017 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.401100 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.401337 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.401466 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.401658 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.401749 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.401964 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.402050 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.402287 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.402373 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.402607 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.402703 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.402925 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.403010 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.403239 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.403332 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.403538 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.403632 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.403844 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.403928 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.404148 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.404232 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.404485 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.404596 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.404792 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.404878 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.405095 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.405187 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.405342 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.405445 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.405643 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.405729 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.405961 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.406046 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.406285 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.406398 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.406602 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.406704 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.407477 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.407579 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.407707 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.407782 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.408029 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.408134 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.408349 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.408477 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.408681 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.408767 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.408986 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.409079 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.409289 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.409383 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.409594 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.409680 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.409898 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.409983 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.410205 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.410312 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.410505 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.410592 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.410806 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.410933 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.411123 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.411217 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.411434 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.411520 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.411753 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.411845 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.412062 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.412148 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.412375 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.412518 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.412789 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.412883 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.413037 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.413124 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.413344 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.413435 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.413675 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.413759 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.413991 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.414084 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.414296 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.414390 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.414611 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.414700 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.414927 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.415013 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.415232 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.415317 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.415534 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.415627 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.415837 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.415921 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.416152 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.416237 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.416496 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.416607 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.416797 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.416889 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.417045 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.417139 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.417341 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.417432 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.417642 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.417734 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.417954 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.418038 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.418260 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.418352 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.418563 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.418646 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.418865 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.418950 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.419164 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.419250 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.419468 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.419553 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.419772 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.419856 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.420342 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.420471 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.420672 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.420759 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.420977 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.421063 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.421279 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.421366 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.421583 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.421669 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.421889 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.421974 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.422191 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.422283 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.422537 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.422644 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.422863 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.422965 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.423166 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.423257 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.423471 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.423562 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.423774 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.423944 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.424080 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.424184 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.424411 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.424513 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.424719 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.424815 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.425024 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.425117 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.425341 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.425427 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.425648 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.425741 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.425946 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.426039 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.426261 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.426354 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.426569 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.426681 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.426870 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.426968 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.427186 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.427284 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.427485 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.427585 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.427789 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.427880 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.428103 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.428194 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.428421 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.428526 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.428737 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.428827 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.429039 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.429130 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.429341 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.429450 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.429643 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.429741 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.429945 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.430037 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.430245 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.430344 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.430545 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.430636 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.430842 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.430941 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.431156 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.431259 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.431473 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.431560 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.431777 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.431869 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.432080 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.432173 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.432381 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.432542 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.432720 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.432806 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:15:32.433050 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.433142 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.433379 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.433462 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.433716 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.433813 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.434027 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.434112 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.434355 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.434441 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.434684 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.434788 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.434999 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.435138 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.435307 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.435392 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.435619 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.435716 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.435939 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.436024 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.436248 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.436333 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.436582 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.436726 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.436891 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.436977 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.437205 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.437291 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.437517 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.437603 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.437842 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.437947 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.438194 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.438290 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.438509 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.438607 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.438825 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.438911 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.439136 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.439251 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.439451 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.439550 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.439773 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.439858 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.440091 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.440177 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.440426 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.440563 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.440764 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.440879 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.441102 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.441214 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.442353 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.442483 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.442483 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.442635 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.442712 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.442803 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.442890 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.442975 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.443053 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.443129 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.443204 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.443292 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.443371 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.443455 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.443534 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.443616 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.443812 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.443906 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.444124 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.444215 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.444453 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.444543 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.444764 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.444927 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.445069 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.445155 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.445376 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.445463 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.445683 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.445776 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.446012 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.446098 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.446320 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.446405 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.446631 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.446717 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.446940 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.447027 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.447248 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.447338 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.447555 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.447642 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.447861 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.447947 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.448167 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.448252 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.448492 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.448580 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.448796 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.448880 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.449099 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.449195 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.449403 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.449492 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.449704 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.449794 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.450017 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.450101 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.450340 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.450426 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.450644 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.450729 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.450974 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.451067 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.451278 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.451363 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.451586 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.451671 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.451894 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.451988 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.452203 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.452286 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.452540 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.452638 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.452830 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.452930 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.453138 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.453232 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.453441 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.453525 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.454295 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.454408 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.454603 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.454688 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.454907 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.454992 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.455226 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.455311 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.455527 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.455611 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.455830 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.455915 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.456140 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.456226 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.456469 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.456556 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.456780 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.456866 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.457089 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.457183 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.457408 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.457495 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.457718 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.457803 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.458023 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.458109 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.458354 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.458439 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.458682 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.458778 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.458990 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.459082 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.459312 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.459437 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.459635 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.459732 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.459947 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.460032 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.460250 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.460334 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.460583 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.460684 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.460890 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.460974 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.461189 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.461273 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.461492 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.461586 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.461797 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.461883 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.462100 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.462194 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.462404 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.462490 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.462706 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.462811 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.463004 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.463090 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.463304 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.463398 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.463621 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.463707 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.463925 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.464017 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.464228 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.464321 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.464551 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.464637 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.464855 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.464940 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.465194 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.465288 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.465497 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.465589 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.465829 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.465923 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.466160 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.466246 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.466475 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.466559 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.466792 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.466885 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.467101 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.467193 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.467415 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.467501 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.467723 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.467815 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.468029 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.468113 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.468333 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.468451 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.468673 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.468771 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.468995 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.469087 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.469335 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.469421 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.470256 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.470357 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.470565 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.470650 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.470886 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.470971 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.471195 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.471288 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.471513 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.471604 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.471814 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.471902 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.472127 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.472214 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.472483 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.472573 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.472817 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.472913 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.473129 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.473216 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.473447 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.473532 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.473756 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.473841 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.474068 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.474162 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.474377 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.474463 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.474687 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.474850 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.474992 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.475078 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.475298 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.475384 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.475616 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.475713 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.475924 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.476009 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.476237 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.476322 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.476567 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.476671 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.476887 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.476980 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.477192 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.477284 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.477506 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.477601 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.477810 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.477895 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.478121 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.478208 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.478444 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.478530 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.478772 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.478858 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.479084 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.479168 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.479391 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.479476 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.479709 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.479796 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.480018 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.480104 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.480325 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.480440 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.480661 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.480747 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.480964 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.481057 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.481265 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.481351 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.481571 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.481656 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.481882 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.481976 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.482189 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.482274 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.482497 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.482592 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.482805 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.482937 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.483109 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.483195 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.483415 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.483501 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.483714 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.483811 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.484014 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.484099 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.484320 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.484440 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.484663 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.484762 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.485028 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.485122 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.485353 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.485438 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.485670 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.485819 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.485971 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.486131 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.486272 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.486443 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.486591 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.486773 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.486898 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.487091 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.487185 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.487403 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.487507 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.487712 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.487806 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.488020 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.488106 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.488366 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.488485 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.488710 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.488955 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.489041 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.489272 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.489358 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.489592 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.489685 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.489900 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.489986 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.490211 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.490342 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.490520 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.490606 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.490828 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.490920 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.491145 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.491239 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.491456 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.491548 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.491763 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.491849 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.492071 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.492165 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.492379 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.492542 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.492709 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.492802 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.493019 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.493132 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.493336 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.493422 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.493642 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.493728 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.493948 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.494035 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.494255 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.494341 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.494556 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.494641 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.494862 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.494949 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.495176 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.495260 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.495873 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.496008 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.496130 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.496217 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.496361 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.496495 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.496701 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.496787 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.497020 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.497114 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.497336 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.497419 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.497664 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.497757 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.497989 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.498076 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.498296 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.498380 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.498623 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.498720 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.498932 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.499025 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.499237 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.499399 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.499537 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.499628 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.499847 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.499932 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.500150 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.500236 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.500473 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.500594 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.500874 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.500969 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.501212 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.501356 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.501514 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.501608 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.501814 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.501910 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.502118 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.502204 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.502421 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.502507 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.502734 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.502832 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.503083 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.503189 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.503339 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.503426 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.503641 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.503735 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.503959 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.504043 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.504266 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.504352 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.504593 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.504681 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.504893 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.504978 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.505194 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.505279 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.505531 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.505626 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.505831 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.505917 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.506164 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.506252 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.506490 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.506576 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.506827 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.506912 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.507131 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.507225 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.507434 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.507574 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.507754 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.507847 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.508056 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.508152 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.508358 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.508496 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.508684 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.508770 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.508994 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.509091 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.509299 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.509385 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.509599 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.509692 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.509905 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.509999 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.510211 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.510296 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.510517 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.510609 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.510823 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.510917 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.511121 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.511207 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.511427 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.511514 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.511728 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.511815 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.512035 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.512121 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.512339 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.512453 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.512664 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.512751 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.512965 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.513058 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.513275 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.513372 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.513578 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.513671 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.513876 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.513961 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.514180 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.514266 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.514481 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.514569 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.514796 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.514884 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.515099 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.515194 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.515400 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.515487 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.515703 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.515788 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.516007 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.516101 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.516882 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.517021 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.517181 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.517295 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.517504 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.517638 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.517818 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.517911 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.518123 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.518209 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.518429 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.518523 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.518741 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.518827 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.519043 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.519134 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.519346 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.519433 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.519657 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.519743 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.519974 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.520059 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.520288 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.520374 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.520614 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.520702 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.520920 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.521006 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.521223 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.521331 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.521523 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.521615 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.521824 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.521910 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.522128 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.522220 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.522428 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.522514 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.522728 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.522863 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.523024 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.523109 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.523326 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.523426 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.523618 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.523717 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.523938 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.524032 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.524245 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.524329 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.524568 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.524669 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.524869 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.524955 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.525168 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.525279 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.525506 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.525601 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.525808 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.525902 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.526158 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.526250 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.526460 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.526546 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.526772 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.526856 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.527085 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.527177 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.527394 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.527481 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.527701 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.527787 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.528010 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.528094 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.528309 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.528413 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.528646 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.528734 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.528957 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.529042 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.529264 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.529357 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.529567 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.529659 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.529865 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.530019 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.530184 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.530270 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.530492 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.530577 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.530800 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.530898 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.531118 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.531203 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.531432 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.531516 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.531751 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.532472 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.532711 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.532869 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.533010 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.533223 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.533323 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.533541 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.533641 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.533850 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.533937 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.534160 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.534246 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.534470 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.534558 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.534780 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.534866 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.535091 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.535227 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.535401 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.535488 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.535711 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.535797 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.536019 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.536117 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.536323 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.536464 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.536655 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.536756 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.536960 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.537058 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.537261 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.537347 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.537583 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.537670 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.537887 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.537980 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.538188 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.538273 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.538493 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.538579 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.538793 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.538926 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.539097 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.539181 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.539397 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.539527 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.539828 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.539915 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.540138 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.540224 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.540465 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.540553 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.540771 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.540901 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.541080 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.541166 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.541388 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.541483 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.541700 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.541786 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.542007 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.542092 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.542311 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.542409 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.542723 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.542807 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.543031 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.543115 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.543340 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.543434 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.543649 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.543760 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.543955 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.544215 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.544300 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.544609 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.544812 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.545186 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.545456 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.545541 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.545784 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.545871 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.546091 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.546177 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.546397 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.546481 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.546700 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.546786 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.547022 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.547108 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.547327 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.547430 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.547742 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.547840 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.548193 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.548283 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.548534 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.548624 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.548841 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.548929 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.549197 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.549283 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.549528 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.549628 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.549849 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.549935 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.550156 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.550249 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.550475 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.550570 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.550789 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.550876 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.551089 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.551173 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.551401 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.551498 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.551708 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.551802 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.552028 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.552116 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.552333 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.552435 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.552673 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.552769 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.552986 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.553080 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.553290 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.553377 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.553610 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.553718 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.553930 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.554026 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.554238 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.554334 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.554556 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.554644 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.554949 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.555034 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.555275 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.555361 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.555583 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.555670 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.555891 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.555978 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.556205 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.556291 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.556535 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.556625 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.556840 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.556938 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.557149 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.557237 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.557451 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.557538 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.557751 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.557838 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.558064 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.558157 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.558362 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.558448 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.558668 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.558754 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.558972 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.559066 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.559279 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.559366 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.559581 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.559668 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.559887 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.559986 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.560202 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.560295 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.560528 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.560617 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.560849 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.560953 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.561156 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.561245 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.561474 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.561565 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.561785 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.561871 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.562086 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.562171 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.562388 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.562474 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.562695 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.562783 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.563650 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.563747 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.564005 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.564102 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.564391 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.564493 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.564751 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.564837 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.565054 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.565138 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.565372 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.565468 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.565701 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.565788 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.566027 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.566123 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.566336 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.566430 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.566653 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.566738 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.566973 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.567067 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.567279 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.567365 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.567588 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.567681 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.567905 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.568000 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.568205 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.568297 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.568534 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.568626 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.568843 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.568942 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.569144 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.569232 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.569445 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.569531 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.569746 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.569838 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.570048 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.570133 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.570351 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.570464 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.570651 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.570738 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.570949 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.571035 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.571268 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.571354 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.571568 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.571655 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.571872 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.571958 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.572176 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.572268 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.572502 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.572593 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.572807 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.572893 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.573109 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.573207 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.573445 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.573532 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.573745 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.573831 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.574080 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.574209 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.574393 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.574491 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.574706 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.574791 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.575024 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.575118 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.575330 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.575417 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.575650 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.575736 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.575964 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.576059 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.576277 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.576369 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.576614 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.576702 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.576926 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.577012 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.577234 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.577319 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.577543 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.577635 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.577854 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.577949 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.578160 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.578253 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.578473 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.578708 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.579426 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.579638 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.579940 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.580034 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.580263 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.580485 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.580622 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.580818 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.580938 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.581134 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.581251 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.581446 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.581566 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.581757 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.581879 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.582070 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.582191 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.582382 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.582503 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.582692 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.582832 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.582986 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.583157 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.583297 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.583484 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.583604 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.583822 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.583929 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.584145 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.584272 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.584487 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.584590 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.584807 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.584909 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.585124 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.585222 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.585485 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.585587 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.585802 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.585927 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.586110 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.586201 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.586422 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.586507 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.586737 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.586836 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.587051 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.587138 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.587359 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.587453 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.587669 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.587756 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.587978 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.588070 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.588287 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.588442 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.588623 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.588713 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.588933 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.589020 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.589238 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.589323 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.589549 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.589813 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.589899 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.590129 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.590215 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.590443 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.590538 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.590754 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.590841 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.591076 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.591163 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.591399 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.591485 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.591713 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.591918 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.592004 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.592234 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.592330 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.592595 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.592684 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.592924 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.593142 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.593239 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.593459 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.593547 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.593790 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.593876 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.594115 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.594210 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.594495 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.594655 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.594808 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.594913 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.595094 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.595191 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.595410 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.595496 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.595712 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.595797 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.596016 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.596112 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.596327 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.596433 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.596660 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.596746 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.596960 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.597055 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.597282 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.597368 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.597592 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.597813 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.597909 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.598163 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.598251 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.598480 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.598567 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.598808 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.599004 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.599135 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.599349 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.599436 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.599663 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.599749 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.600000 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.600096 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.600297 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.600393 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.600646 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.600732 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.600953 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.601048 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.601276 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.601376 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.601584 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.601678 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.601886 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.601971 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.602198 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.602282 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.602503 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.602601 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.602806 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.602899 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.603107 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.603201 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.603413 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.603507 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.603719 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.603804 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.604021 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.604115 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.604330 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.604482 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.604690 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.604798 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.605008 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.605094 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.605311 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.605415 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.605615 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.605702 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.605920 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.606015 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.606225 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.606312 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.606526 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.606622 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.606832 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.606923 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.607136 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.607225 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.607438 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.607576 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.607747 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.607833 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.608049 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.608136 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.608357 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.608477 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.608685 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.608785 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.608995 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.609081 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.609296 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.609390 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.609603 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.609696 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.609951 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.610106 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.610289 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.610396 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.610612 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.610708 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.610925 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.611013 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.611242 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.611328 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.611590 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.611689 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.611908 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.611995 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.612213 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.612467 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.612571 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.612810 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.612904 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.613136 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.613231 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.613474 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.613695 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.613809 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.614028 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.614114 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.614344 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.614430 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.614675 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.614771 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.615005 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.615092 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.615310 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.615404 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.615615 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.615708 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.615918 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.616003 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.616234 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.616336 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.616567 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.616655 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.616880 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.616978 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.617193 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.617288 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.617498 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.617621 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.617806 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.617894 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.618115 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.618209 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.618420 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.618505 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.618728 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.618820 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.619036 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.619123 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.619342 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.619441 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.619650 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.619748 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.619959 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.620047 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.620289 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.620374 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.620630 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.620739 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.620941 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.621037 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.621251 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.621337 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.621561 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.621654 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.621867 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.621960 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.622173 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.622259 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.622478 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.622573 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.622787 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.622920 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.623096 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.623184 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.623423 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.623519 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.623732 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.623818 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.624036 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.624122 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.624443 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.624532 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.624766 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.624862 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.625079 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.625165 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.625395 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.625482 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.626273 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.626445 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.626598 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.626687 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.626902 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.627001 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.627240 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.627334 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.628139 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.628234 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.628303 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.628375 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.628510 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.628581 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.628645 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.628717 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.628825 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.628986 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.629139 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.629309 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.629470 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.629612 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.629803 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.629915 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.630384 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.630696 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.631032 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.631364 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.631621 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.631708 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.631984 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.632076 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.632292 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.632380 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.632674 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.632803 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.632981 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.633067 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.633300 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.633400 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.633617 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.633704 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.633928 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.634014 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.634236 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.634323 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.634561 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.634647 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.634867 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.634956 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.635175 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.635316 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.635480 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.635568 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.635785 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.635881 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.636090 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.636176 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.636393 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.636528 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.636779 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.636882 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.637058 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.637145 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.637360 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.637446 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.637681 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.637780 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.637994 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.638081 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.638309 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.638397 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.638621 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.638715 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.638929 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.639022 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.639252 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.639338 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.639556 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.639644 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.639867 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.639954 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.640172 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.640264 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.640501 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.640591 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.640819 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.640905 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.641234 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.641840 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.642076 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.642172 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.642402 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.642503 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.642724 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.642819 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.643045 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.643131 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.643385 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.643472 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.643697 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.643793 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.644037 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.644124 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.644362 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.644481 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.644698 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.644792 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.645008 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.645105 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.645311 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.645398 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:15:32.645553 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 15 14:15:32.645644 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 15 14:15:32.667881 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG oslo_db.sqlalchemy.engines [None req-c4df189c-6807-4eaf-9fd5-7c180c957b39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 14:15:32.669125 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG oslo_db.sqlalchemy.engines [None req-9db8a559-bacd-4706-9074-75e3748be0be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 14:15:32.730825 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.context [None req-c4df189c-6807-4eaf-9fd5-7c180c957b39 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f90dd206-7018-4083-9442-b93ea6e9dfe9(cell1) {{(pid=101918) load_cells /opt/stack/nova/nova/context.py:464}} Feb 15 14:15:32.731812 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.context [None req-9db8a559-bacd-4706-9074-75e3748be0be None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f90dd206-7018-4083-9442-b93ea6e9dfe9(cell1) {{(pid=101917) load_cells /opt/stack/nova/nova/context.py:464}} Feb 15 14:15:32.735091 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG oslo_concurrency.lockutils [None req-c4df189c-6807-4eaf-9fd5-7c180c957b39 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:15:32.736012 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG oslo_concurrency.lockutils [None req-9db8a559-bacd-4706-9074-75e3748be0be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:15:32.736678 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG oslo_concurrency.lockutils [None req-c4df189c-6807-4eaf-9fd5-7c180c957b39 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:15:32.737492 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG oslo_concurrency.lockutils [None req-c4df189c-6807-4eaf-9fd5-7c180c957b39 None None] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:15:32.737628 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG oslo_concurrency.lockutils [None req-9db8a559-bacd-4706-9074-75e3748be0be None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:15:32.738439 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG oslo_concurrency.lockutils [None req-9db8a559-bacd-4706-9074-75e3748be0be None None] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:15:32.739407 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG oslo_concurrency.lockutils [None req-c4df189c-6807-4eaf-9fd5-7c180c957b39 None None] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:15:32.740350 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG oslo_concurrency.lockutils [None req-9db8a559-bacd-4706-9074-75e3748be0be None None] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:15:32.749664 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG oslo_db.sqlalchemy.engines [None req-c4df189c-6807-4eaf-9fd5-7c180c957b39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 14:15:32.753176 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG oslo_db.sqlalchemy.engines [None req-9db8a559-bacd-4706-9074-75e3748be0be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 14:15:32.755375 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG oslo_db.sqlalchemy.engines [None req-9db8a559-bacd-4706-9074-75e3748be0be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 14:15:32.891114 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG oslo_db.sqlalchemy.engines [None req-c4df189c-6807-4eaf-9fd5-7c180c957b39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 14:15:32.913070 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG oslo_db.sqlalchemy.engines [None req-c4df189c-6807-4eaf-9fd5-7c180c957b39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 14:15:32.916745 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG oslo_db.sqlalchemy.engines [None req-9db8a559-bacd-4706-9074-75e3748be0be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 14:15:33.364284 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: WARNING keystonemiddleware.auth_token [None req-c4df189c-6807-4eaf-9fd5-7c180c957b39 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 15 14:15:33.366476 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: WARNING keystonemiddleware.auth_token [None req-9db8a559-bacd-4706-9074-75e3748be0be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 15 14:15:33.370902 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: WARNING keystonemiddleware.auth_token [None req-c4df189c-6807-4eaf-9fd5-7c180c957b39 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 15 14:15:33.373050 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: WARNING keystonemiddleware.auth_token [None req-9db8a559-bacd-4706-9074-75e3748be0be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 15 14:15:33.592808 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: WARNING keystonemiddleware.auth_token [None req-c4df189c-6807-4eaf-9fd5-7c180c957b39 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 15 14:15:33.596273 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: WARNING keystonemiddleware.auth_token [None req-9db8a559-bacd-4706-9074-75e3748be0be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 15 14:15:33.598018 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: WARNING keystonemiddleware.auth_token [None req-c4df189c-6807-4eaf-9fd5-7c180c957b39 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 15 14:15:33.601418 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: WARNING keystonemiddleware.auth_token [None req-9db8a559-bacd-4706-9074-75e3748be0be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 15 14:15:33.603590 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56460e0cd9c0 pid: 101918 (default app) Feb 15 14:15:33.605707 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-c4df189c-6807-4eaf-9fd5-7c180c957b39 None None] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:15:33.606792 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-c4df189c-6807-4eaf-9fd5-7c180c957b39 None None] 10.222.0.83 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001675 Feb 15 14:15:33.606908 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56460e0cd9c0 pid: 101917 (default app) Feb 15 14:15:33.607205 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 1/1] 10.222.0.83 () {50 vars in 788 bytes} [Tue Feb 15 14:15:33 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:16:55.591968 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-9db8a559-bacd-4706-9074-75e3748be0be None None] Calling method '>' {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:16:55.594052 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-9db8a559-bacd-4706-9074-75e3748be0be None None] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002781 Feb 15 14:16:55.594629 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 1/2] 10.222.0.83 () {54 vars in 930 bytes} [Tue Feb 15 14:16:55 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:16:56.018947 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-05c3873a-ae09-448e-807d-6f8321759e2e admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:16:56.049672 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-05c3873a-ae09-448e-807d-6f8321759e2e admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.448967 Feb 15 14:16:56.050493 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 2/3] 10.222.0.83 () {60 vars in 1291 bytes} [Tue Feb 15 14:16:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:16:58.418972 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-9db8a559-bacd-4706-9074-75e3748be0be None None] Calling method '>' {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:16:58.419895 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-9db8a559-bacd-4706-9074-75e3748be0be None None] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Feb 15 14:16:58.420305 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 2/4] 10.222.0.83 () {54 vars in 930 bytes} [Tue Feb 15 14:16:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:16:58.484927 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-6ad768e4-a97a-4e05-9c3a-dc199cdd46a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "cirros256", "disk": 1, "vcpus": 1, "id": "c1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:16:58.502585 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:16:58.502585 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: warnings.warn(msg) Feb 15 14:16:58.531467 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-6ad768e4-a97a-4e05-9c3a-dc199cdd46a5 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105046 Feb 15 14:16:58.532212 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 3/5] 10.222.0.83 () {64 vars in 1282 bytes} [Tue Feb 15 14:16:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 14:16:58.753776 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-8221be4d-ab8c-4a53-8f70-9adb2902ec6f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:16:58.756146 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:16:58.756146 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: warnings.warn(msg) Feb 15 14:16:58.804936 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-8221be4d-ab8c-4a53-8f70-9adb2902ec6f admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.264769 Feb 15 14:16:58.814535 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 3/6] 10.222.0.83 () {64 vars in 1335 bytes} [Tue Feb 15 14:16:58 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:17:01.227981 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-6ad768e4-a97a-4e05-9c3a-dc199cdd46a5 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:01.229056 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-6ad768e4-a97a-4e05-9c3a-dc199cdd46a5 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Feb 15 14:17:01.229458 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 4/7] 10.222.0.83 () {54 vars in 930 bytes} [Tue Feb 15 14:17:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:17:01.341957 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-a2ecdc3d-14ed-4b28-af66-e9b256059639 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d1", "name": "ds512M", "disk": 5, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:17:01.370558 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:17:01.370558 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: warnings.warn(msg) Feb 15 14:17:01.393344 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-a2ecdc3d-14ed-4b28-af66-e9b256059639 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.157862 Feb 15 14:17:01.394238 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 4/8] 10.222.0.83 () {64 vars in 1282 bytes} [Tue Feb 15 14:17:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 15 14:17:01.407219 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-16bbdc36-2ed3-4716-84f9-65983551f403 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:17:01.408965 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:17:01.408965 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: warnings.warn(msg) Feb 15 14:17:01.445914 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-16bbdc36-2ed3-4716-84f9-65983551f403 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042980 Feb 15 14:17:01.446429 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 5/9] 10.222.0.83 () {64 vars in 1335 bytes} [Tue Feb 15 14:17:01 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:17:03.824990 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-a2ecdc3d-14ed-4b28-af66-e9b256059639 admin admin] Calling method '>' {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:03.826011 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-a2ecdc3d-14ed-4b28-af66-e9b256059639 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Feb 15 14:17:03.826414 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 5/10] 10.222.0.83 () {54 vars in 930 bytes} [Tue Feb 15 14:17:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:17:03.889062 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-1d540a80-52c2-4bae-90d8-02ea269a2174 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 1024, "name": "ds1G", "rxtx_factor": 1.0, "id": "d2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0}} {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:17:03.908074 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-1d540a80-52c2-4bae-90d8-02ea269a2174 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075575 Feb 15 14:17:03.908646 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 6/11] 10.222.0.83 () {64 vars in 1282 bytes} [Tue Feb 15 14:17:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 15 14:17:03.920642 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-77be3f0d-c610-44a7-867e-c3c349d1aaf1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:17:03.945631 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-77be3f0d-c610-44a7-867e-c3c349d1aaf1 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028811 Feb 15 14:17:03.946219 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 6/12] 10.222.0.83 () {64 vars in 1335 bytes} [Tue Feb 15 14:17:03 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:17:06.289487 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-1d540a80-52c2-4bae-90d8-02ea269a2174 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:06.290877 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-1d540a80-52c2-4bae-90d8-02ea269a2174 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001731 Feb 15 14:17:06.291438 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 7/13] 10.222.0.83 () {54 vars in 930 bytes} [Tue Feb 15 14:17:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:17:06.350275 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-e28fec9e-830b-43ea-9fa5-e0fddc706889 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "disk": 10, "os-flavor-access:is_public": true, "id": "d3"}} {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:17:06.367896 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-e28fec9e-830b-43ea-9fa5-e0fddc706889 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070367 Feb 15 14:17:06.369257 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 7/14] 10.222.0.83 () {64 vars in 1282 bytes} [Tue Feb 15 14:17:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 15 14:17:06.380529 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-9bca8e1b-cebf-4fb7-8f0b-81b4fa5c566d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:17:06.404705 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-9bca8e1b-cebf-4fb7-8f0b-81b4fa5c566d admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027647 Feb 15 14:17:06.405308 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 8/15] 10.222.0.83 () {64 vars in 1335 bytes} [Tue Feb 15 14:17:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:17:08.754580 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-e28fec9e-830b-43ea-9fa5-e0fddc706889 admin admin] Calling method '>' {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:08.755597 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-e28fec9e-830b-43ea-9fa5-e0fddc706889 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Feb 15 14:17:08.755996 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 8/16] 10.222.0.83 () {54 vars in 930 bytes} [Tue Feb 15 14:17:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:17:08.819616 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-7a836ece-4bd1-4a9c-b62c-ac59fda98760 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4, "rxtx_factor": 1.0, "disk": 20}} {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:17:08.839955 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-7a836ece-4bd1-4a9c-b62c-ac59fda98760 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077369 Feb 15 14:17:08.840794 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 9/17] 10.222.0.83 () {64 vars in 1282 bytes} [Tue Feb 15 14:17:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 15 14:17:08.857318 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-aac1fc22-b839-4349-b7bc-328d09a66585 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:17:08.880958 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-aac1fc22-b839-4349-b7bc-328d09a66585 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027000 Feb 15 14:17:08.881392 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 9/18] 10.222.0.83 () {64 vars in 1335 bytes} [Tue Feb 15 14:17:08 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:17:11.238738 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-7a836ece-4bd1-4a9c-b62c-ac59fda98760 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:11.239748 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-7a836ece-4bd1-4a9c-b62c-ac59fda98760 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Feb 15 14:17:11.240309 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 10/19] 10.222.0.83 () {54 vars in 930 bytes} [Tue Feb 15 14:17:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:17:11.307020 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-b746a698-332e-48f8-b2aa-964494566af0 admin admin] Calling method '>' {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:11.331832 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-b746a698-332e-48f8-b2aa-964494566af0 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.085236 Feb 15 14:17:11.332497 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 10/20] 10.222.0.83 () {60 vars in 1291 bytes} [Tue Feb 15 14:17:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:17:14.229741 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-7a836ece-4bd1-4a9c-b62c-ac59fda98760 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:14.231052 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-7a836ece-4bd1-4a9c-b62c-ac59fda98760 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001905 Feb 15 14:17:14.231526 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 11/21] 10.222.0.83 () {54 vars in 930 bytes} [Tue Feb 15 14:17:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:17:14.297445 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-6e777bb9-a34b-4813-81ed-7b3c34b8ec91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "disk": 1, "id": "1", "vcpus": 1, "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:17:14.316548 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-6e777bb9-a34b-4813-81ed-7b3c34b8ec91 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.077492 Feb 15 14:17:14.317114 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 11/22] 10.222.0.83 () {64 vars in 1282 bytes} [Tue Feb 15 14:17:14 2022] POST /compute/v2.1/flavors => generated 402 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 14:17:14.332622 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-6ce3edb7-8f95-48bf-8d62-6d04c4619870 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:17:14.360077 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-6ce3edb7-8f95-48bf-8d62-6d04c4619870 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032038 Feb 15 14:17:14.360940 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 12/23] 10.222.0.83 () {64 vars in 1332 bytes} [Tue Feb 15 14:17:14 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:17:17.265820 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-6e777bb9-a34b-4813-81ed-7b3c34b8ec91 admin admin] Calling method '>' {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:17.266825 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-6e777bb9-a34b-4813-81ed-7b3c34b8ec91 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Feb 15 14:17:17.267225 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 12/24] 10.222.0.83 () {54 vars in 930 bytes} [Tue Feb 15 14:17:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:17:17.327238 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-203ad1be-f9a1-4103-8a7b-d55bce53ba2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "rxtx_factor": 1.0, "ram": 2048, "disk": 20}} {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:17:17.345439 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-203ad1be-f9a1-4103-8a7b-d55bce53ba2c admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072122 Feb 15 14:17:17.345994 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 13/25] 10.222.0.83 () {64 vars in 1282 bytes} [Tue Feb 15 14:17:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 15 14:17:17.358041 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-e8d73c49-d2e3-4252-8ffa-0ebb905f0cdf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:17:17.380907 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-e8d73c49-d2e3-4252-8ffa-0ebb905f0cdf admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026369 Feb 15 14:17:17.381469 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 13/26] 10.222.0.83 () {64 vars in 1332 bytes} [Tue Feb 15 14:17:17 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:17:19.726148 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-203ad1be-f9a1-4103-8a7b-d55bce53ba2c admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:19.727266 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-203ad1be-f9a1-4103-8a7b-d55bce53ba2c admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001664 Feb 15 14:17:19.727712 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 14/27] 10.222.0.83 () {54 vars in 930 bytes} [Tue Feb 15 14:17:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:17:19.785857 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-bb458c03-781f-4df6-b5f5-c2b817e7b7a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 2, "id": "3", "rxtx_factor": 1.0}} {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:17:19.804293 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-bb458c03-781f-4df6-b5f5-c2b817e7b7a4 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070402 Feb 15 14:17:19.804869 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 14/28] 10.222.0.83 () {64 vars in 1282 bytes} [Tue Feb 15 14:17:19 2022] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 14:17:19.817023 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-3897e319-a995-45ae-92f1-f1cb57990812 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:17:19.841142 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-3897e319-a995-45ae-92f1-f1cb57990812 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027691 Feb 15 14:17:19.841745 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 15/29] 10.222.0.83 () {64 vars in 1332 bytes} [Tue Feb 15 14:17:19 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:17:22.241739 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-bb458c03-781f-4df6-b5f5-c2b817e7b7a4 admin admin] Calling method '>' {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:22.242757 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-bb458c03-781f-4df6-b5f5-c2b817e7b7a4 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Feb 15 14:17:22.243310 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 15/30] 10.222.0.83 () {54 vars in 930 bytes} [Tue Feb 15 14:17:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:17:22.301601 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-70835aca-57a5-41ab-ab92-32b40385e409 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "ram": 8192, "id": "4", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:17:22.320661 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-70835aca-57a5-41ab-ab92-32b40385e409 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071182 Feb 15 14:17:22.321226 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 16/31] 10.222.0.83 () {64 vars in 1282 bytes} [Tue Feb 15 14:17:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 14:17:22.333431 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-2fd128ac-3e16-4e1b-9440-417a711af3b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:17:22.357294 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-2fd128ac-3e16-4e1b-9440-417a711af3b0 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027369 Feb 15 14:17:22.358324 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 16/32] 10.222.0.83 () {64 vars in 1332 bytes} [Tue Feb 15 14:17:22 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:17:24.833929 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-70835aca-57a5-41ab-ab92-32b40385e409 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:24.834946 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-70835aca-57a5-41ab-ab92-32b40385e409 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Feb 15 14:17:24.836707 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 17/33] 10.222.0.83 () {54 vars in 930 bytes} [Tue Feb 15 14:17:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:17:24.897062 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-d7e38d44-3692-4e43-bcda-8e6854c678bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "swap": 0, "id": "5", "name": "m1.xlarge", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 160}} {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:17:24.916700 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-d7e38d44-3692-4e43-bcda-8e6854c678bd admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.074904 Feb 15 14:17:24.917251 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 17/34] 10.222.0.83 () {64 vars in 1282 bytes} [Tue Feb 15 14:17:24 2022] POST /compute/v2.1/flavors => generated 408 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 15 14:17:24.929121 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-d920cc24-8934-4102-9b77-1d5d7fcef1de admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:17:24.957297 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-d920cc24-8934-4102-9b77-1d5d7fcef1de admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032118 Feb 15 14:17:24.960824 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 18/35] 10.222.0.83 () {64 vars in 1332 bytes} [Tue Feb 15 14:17:24 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:17:49.391011 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-d7e38d44-3692-4e43-bcda-8e6854c678bd admin admin] Calling method '>' {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:49.392004 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-d7e38d44-3692-4e43-bcda-8e6854c678bd admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Feb 15 14:17:49.392392 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 18/36] 10.222.0.83 () {54 vars in 930 bytes} [Tue Feb 15 14:17:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:17:49.449338 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-b35b105e-25d0-48e6-9577-58db4f9fba23 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:49.466141 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-b35b105e-25d0-48e6-9577-58db4f9fba23 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067807 Feb 15 14:17:49.466712 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 19/37] 10.222.0.83 () {60 vars in 1291 bytes} [Tue Feb 15 14:17:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 14:17:50.847630 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-d7e38d44-3692-4e43-bcda-8e6854c678bd admin admin] Calling method '>' {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:50.848729 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-d7e38d44-3692-4e43-bcda-8e6854c678bd admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Feb 15 14:17:50.849130 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 19/38] 10.222.0.83 () {56 vars in 1074 bytes} [Tue Feb 15 14:17:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:17:51.056419 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-c1c016ee-42bd-41bc-a821-1030cebd7ee3 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:51.062283 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.wsgi [None req-c1c016ee-42bd-41bc-a821-1030cebd7ee3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 15 14:17:51.062790 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-c1c016ee-42bd-41bc-a821-1030cebd7ee3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:17:51.063584 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-c1c016ee-42bd-41bc-a821-1030cebd7ee3 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061281 Feb 15 14:17:51.064101 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 20/39] 10.222.0.83 () {60 vars in 1190 bytes} [Tue Feb 15 14:17:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 15 14:17:51.073858 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-8c39dddb-83e2-4765-846d-7d0879bbbd82 admin admin] Calling method '>' {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:51.094699 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-8c39dddb-83e2-4765-846d-7d0879bbbd82 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024935 Feb 15 14:17:51.095237 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 20/40] 10.222.0.83 () {60 vars in 1210 bytes} [Tue Feb 15 14:17:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 14:17:51.104527 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-46be241c-b53b-4e1f-bc11-13b22c70670a admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:51.125232 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-46be241c-b53b-4e1f-bc11-13b22c70670a admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024172 Feb 15 14:17:51.125771 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 21/41] 10.222.0.83 () {60 vars in 1210 bytes} [Tue Feb 15 14:17:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:17:51.134852 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-54105a6a-1baf-4fc0-b2e7-767537be9355 admin admin] Calling method '>' {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:51.140936 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.wsgi [None req-54105a6a-1baf-4fc0-b2e7-767537be9355 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 15 14:17:51.141502 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-54105a6a-1baf-4fc0-b2e7-767537be9355 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:17:51.142281 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-54105a6a-1baf-4fc0-b2e7-767537be9355 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011014 Feb 15 14:17:51.142769 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 21/42] 10.222.0.83 () {60 vars in 1190 bytes} [Tue Feb 15 14:17:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 15 14:17:52.409062 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-46be241c-b53b-4e1f-bc11-13b22c70670a admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:52.410076 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-46be241c-b53b-4e1f-bc11-13b22c70670a admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Feb 15 14:17:52.410466 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 22/43] 10.222.0.83 () {56 vars in 1074 bytes} [Tue Feb 15 14:17:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:17:52.599114 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-cbf5fb3d-f260-42fc-b392-c0ae158e50e8 admin admin] Calling method '>' {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:52.604343 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.wsgi [None req-cbf5fb3d-f260-42fc-b392-c0ae158e50e8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 15 14:17:52.604930 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-cbf5fb3d-f260-42fc-b392-c0ae158e50e8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:17:52.605704 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-cbf5fb3d-f260-42fc-b392-c0ae158e50e8 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058338 Feb 15 14:17:52.606213 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 22/44] 10.222.0.83 () {60 vars in 1190 bytes} [Tue Feb 15 14:17:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 15 14:17:52.615287 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-a7646535-ed6c-4604-8bb7-632053e1592a admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:52.628481 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-a7646535-ed6c-4604-8bb7-632053e1592a admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016587 Feb 15 14:17:52.628951 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 23/45] 10.222.0.83 () {60 vars in 1210 bytes} [Tue Feb 15 14:17:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:17:52.638439 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-292f37ac-2db2-4940-a5ea-9d5ff9e08000 admin admin] Calling method '>' {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:52.652480 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-292f37ac-2db2-4940-a5ea-9d5ff9e08000 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017884 Feb 15 14:17:52.653002 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 23/46] 10.222.0.83 () {60 vars in 1210 bytes} [Tue Feb 15 14:17:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:17:52.661745 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-b19ccb11-ffb9-4984-8f4c-ae1b1588d4f2 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:52.667055 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.wsgi [None req-b19ccb11-ffb9-4984-8f4c-ae1b1588d4f2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 15 14:17:52.667606 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-b19ccb11-ffb9-4984-8f4c-ae1b1588d4f2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:17:52.668375 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-b19ccb11-ffb9-4984-8f4c-ae1b1588d4f2 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010038 Feb 15 14:17:52.668879 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 24/47] 10.222.0.83 () {60 vars in 1190 bytes} [Tue Feb 15 14:17:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 15 14:17:53.945430 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-292f37ac-2db2-4940-a5ea-9d5ff9e08000 admin admin] Calling method '>' {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:53.946429 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-292f37ac-2db2-4940-a5ea-9d5ff9e08000 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Feb 15 14:17:53.946822 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 24/48] 10.222.0.83 () {56 vars in 1074 bytes} [Tue Feb 15 14:17:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:17:54.135683 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-5e5db07a-4de0-4d39-b3b7-d8387af5a398 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:54.140904 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.wsgi [None req-5e5db07a-4de0-4d39-b3b7-d8387af5a398 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 15 14:17:54.141460 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-5e5db07a-4de0-4d39-b3b7-d8387af5a398 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:17:54.142231 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-5e5db07a-4de0-4d39-b3b7-d8387af5a398 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058599 Feb 15 14:17:54.142727 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 25/49] 10.222.0.83 () {60 vars in 1193 bytes} [Tue Feb 15 14:17:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 15 14:17:54.151873 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-5b30c6f1-062e-4964-a051-240afc70f48d admin admin] Calling method '>' {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:54.164991 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-5b30c6f1-062e-4964-a051-240afc70f48d admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016595 Feb 15 14:17:54.165513 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 25/50] 10.222.0.83 () {60 vars in 1210 bytes} [Tue Feb 15 14:17:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:17:54.175711 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-2c059029-9276-4746-ba60-7c44e03985e0 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:54.189470 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-2c059029-9276-4746-ba60-7c44e03985e0 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017546 Feb 15 14:17:54.189990 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 26/51] 10.222.0.83 () {60 vars in 1210 bytes} [Tue Feb 15 14:17:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:17:54.199100 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-b8fc89e5-d758-4b04-96ef-18a75890c4b4 admin admin] Calling method '>' {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:54.204226 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.wsgi [None req-b8fc89e5-d758-4b04-96ef-18a75890c4b4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 15 14:17:54.204813 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-b8fc89e5-d758-4b04-96ef-18a75890c4b4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:17:54.205585 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-b8fc89e5-d758-4b04-96ef-18a75890c4b4 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010187 Feb 15 14:17:54.206070 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 26/52] 10.222.0.83 () {60 vars in 1193 bytes} [Tue Feb 15 14:17:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 15 14:17:55.486234 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-2c059029-9276-4746-ba60-7c44e03985e0 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:55.487347 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-2c059029-9276-4746-ba60-7c44e03985e0 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Feb 15 14:17:55.487783 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 27/53] 10.222.0.83 () {56 vars in 1074 bytes} [Tue Feb 15 14:17:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:17:55.679409 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-de2d3366-4839-4d8a-a24a-537a2ed5c724 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:17:55.698491 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-de2d3366-4839-4d8a-a24a-537a2ed5c724 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070250 Feb 15 14:17:55.699017 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 27/54] 10.222.0.83 () {64 vars in 1235 bytes} [Tue Feb 15 14:17:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 14:17:56.962752 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-2c059029-9276-4746-ba60-7c44e03985e0 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:56.963848 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-2c059029-9276-4746-ba60-7c44e03985e0 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001393 Feb 15 14:17:56.964239 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 28/55] 10.222.0.83 () {56 vars in 1074 bytes} [Tue Feb 15 14:17:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:17:57.156683 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-db2e24f4-eca5-41bb-b894-ba19bb03c990 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:17:57.174411 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-db2e24f4-eca5-41bb-b894-ba19bb03c990 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.070642 Feb 15 14:17:57.174950 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 28/56] 10.222.0.83 () {64 vars in 1235 bytes} [Tue Feb 15 14:17:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 14:17:58.449618 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-2c059029-9276-4746-ba60-7c44e03985e0 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:58.450613 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-2c059029-9276-4746-ba60-7c44e03985e0 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002559 Feb 15 14:17:58.451013 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 29/57] 10.222.0.83 () {56 vars in 1074 bytes} [Tue Feb 15 14:17:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:17:58.642014 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-3323e101-8c2c-4e89-beae-2b73a54136b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:17:58.660062 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-3323e101-8c2c-4e89-beae-2b73a54136b7 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068736 Feb 15 14:17:58.660555 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 29/58] 10.222.0.83 () {64 vars in 1235 bytes} [Tue Feb 15 14:17:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 14:17:59.937373 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-2c059029-9276-4746-ba60-7c44e03985e0 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:17:59.938677 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-2c059029-9276-4746-ba60-7c44e03985e0 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001725 Feb 15 14:17:59.939182 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 30/59] 10.222.0.83 () {56 vars in 1074 bytes} [Tue Feb 15 14:17:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:18:00.130905 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-564c7714-cf34-4b0d-b72b-ff186d3cd743 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:18:00.148345 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-564c7714-cf34-4b0d-b72b-ff186d3cd743 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068986 Feb 15 14:18:00.148934 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 30/60] 10.222.0.83 () {64 vars in 1235 bytes} [Tue Feb 15 14:18:00 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 15 14:18:01.423117 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-2c059029-9276-4746-ba60-7c44e03985e0 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:18:01.424118 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-2c059029-9276-4746-ba60-7c44e03985e0 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Feb 15 14:18:01.424542 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 31/61] 10.222.0.83 () {56 vars in 1074 bytes} [Tue Feb 15 14:18:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:18:01.612182 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-c7e9d860-b2cc-46e9-92e4-2f9c72476593 admin admin] Calling method '>' {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:18:01.632657 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-c7e9d860-b2cc-46e9-92e4-2f9c72476593 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070283 Feb 15 14:18:01.633122 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 31/62] 10.222.0.83 () {60 vars in 1202 bytes} [Tue Feb 15 14:18:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:18:52.190567 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-2c059029-9276-4746-ba60-7c44e03985e0 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:18:52.191644 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-2c059029-9276-4746-ba60-7c44e03985e0 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Feb 15 14:18:52.192043 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 32/63] 10.222.0.83 () {54 vars in 930 bytes} [Tue Feb 15 14:18:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:18:52.249076 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-0f6f007c-bc5b-4609-9d77-da4158ee21e5 admin admin] Calling method '>' {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:18:52.268992 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-0f6f007c-bc5b-4609-9d77-da4158ee21e5 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071306 Feb 15 14:18:52.269532 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 32/64] 10.222.0.83 () {60 vars in 1291 bytes} [Tue Feb 15 14:18:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:18:52.290799 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-82e0b497-6bcf-46ff-8fe6-49814970ad14 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:18:52.298819 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-82e0b497-6bcf-46ff-8fe6-49814970ad14 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011533 Feb 15 14:18:52.299333 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 33/65] 10.222.0.83 () {60 vars in 1282 bytes} [Tue Feb 15 14:18:52 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:18:52.310672 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-3b0524ce-aee8-406d-8801-05b43d135ae8 admin admin] Calling method '>' {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:18:52.318239 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-3b0524ce-aee8-406d-8801-05b43d135ae8 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011561 Feb 15 14:18:52.318746 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 33/66] 10.222.0.83 () {60 vars in 1285 bytes} [Tue Feb 15 14:18:52 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:18:52.330035 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-3fa68547-97f0-4455-99e1-55663f06f862 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:18:52.337650 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-3fa68547-97f0-4455-99e1-55663f06f862 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010943 Feb 15 14:18:52.338174 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 34/67] 10.222.0.83 () {60 vars in 1285 bytes} [Tue Feb 15 14:18:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:18:52.348728 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-cc2987b2-a6e2-45e6-9156-625967b6fbe9 admin admin] Calling method '>' {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:18:52.356471 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-cc2987b2-a6e2-45e6-9156-625967b6fbe9 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011001 Feb 15 14:18:52.356992 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 34/68] 10.222.0.83 () {60 vars in 1282 bytes} [Tue Feb 15 14:18:52 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:20:30.936008 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-046199f4-ea0f-4968-97ed-737d2388989c tempest-verify_tempest_config-314436037 tempest-verify_tempest_config-314436037-project] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:20:30.938395 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-046199f4-ea0f-4968-97ed-737d2388989c tempest-verify_tempest_config-314436037 tempest-verify_tempest_config-314436037-project] 10.222.0.83 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.111083 Feb 15 14:20:30.938930 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 35/69] 10.222.0.83 () {58 vars in 1133 bytes} [Tue Feb 15 14:20:30 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 14:22:12.785691 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-cc2987b2-a6e2-45e6-9156-625967b6fbe9 admin admin] Calling method '>' {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:22:12.786683 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-cc2987b2-a6e2-45e6-9156-625967b6fbe9 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Feb 15 14:22:12.787065 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 35/70] 10.222.0.83 () {56 vars in 1074 bytes} [Tue Feb 15 14:22:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:22:13.044485 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-9b9ce4af-a9a7-4333-9a9c-569f7c86fad1 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:22:13.045671 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:22:13.045671 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: warnings.warn(msg) Feb 15 14:22:13.047194 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG oslo_concurrency.lockutils [None req-9b9ce4af-a9a7-4333-9a9c-569f7c86fad1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:22:13.047632 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG oslo_concurrency.lockutils [None req-9b9ce4af-a9a7-4333-9a9c-569f7c86fad1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:22:13.048445 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG oslo_concurrency.lockutils [None req-9b9ce4af-a9a7-4333-9a9c-569f7c86fad1 admin admin] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:22:13.048873 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG oslo_concurrency.lockutils [None req-9b9ce4af-a9a7-4333-9a9c-569f7c86fad1 admin admin] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:22:13.081549 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-9b9ce4af-a9a7-4333-9a9c-569f7c86fad1 admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.147763 Feb 15 14:22:13.082100 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 36/71] 10.222.0.83 () {60 vars in 1193 bytes} [Tue Feb 15 14:22:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 14:22:14.368460 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-cc2987b2-a6e2-45e6-9156-625967b6fbe9 admin admin] Calling method '>' {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:22:14.369453 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-cc2987b2-a6e2-45e6-9156-625967b6fbe9 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Feb 15 14:22:14.369842 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 36/72] 10.222.0.83 () {56 vars in 1074 bytes} [Tue Feb 15 14:22:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:22:14.560978 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-e781dd34-c938-4dd8-9913-afce3751cf28 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:22:14.562159 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:22:14.562159 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: warnings.warn(msg) Feb 15 14:22:14.563661 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG oslo_concurrency.lockutils [None req-e781dd34-c938-4dd8-9913-afce3751cf28 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:22:14.564094 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG oslo_concurrency.lockutils [None req-e781dd34-c938-4dd8-9913-afce3751cf28 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:22:14.564942 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG oslo_concurrency.lockutils [None req-e781dd34-c938-4dd8-9913-afce3751cf28 admin admin] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:22:14.565363 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG oslo_concurrency.lockutils [None req-e781dd34-c938-4dd8-9913-afce3751cf28 admin admin] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:22:14.586285 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-e781dd34-c938-4dd8-9913-afce3751cf28 admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075441 Feb 15 14:22:14.586876 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 37/73] 10.222.0.83 () {60 vars in 1193 bytes} [Tue Feb 15 14:22:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 14:22:26.307398 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-cc2987b2-a6e2-45e6-9156-625967b6fbe9 admin admin] Calling method '>' {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:22:26.308379 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-cc2987b2-a6e2-45e6-9156-625967b6fbe9 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001393 Feb 15 14:22:26.308791 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 37/74] 10.222.0.83 () {56 vars in 1074 bytes} [Tue Feb 15 14:22:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:22:26.502044 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-0e537d41-68fa-4b8f-be86-502ff8366039 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:22:26.503223 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:22:26.503223 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: warnings.warn(msg) Feb 15 14:22:26.504917 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG oslo_concurrency.lockutils [None req-0e537d41-68fa-4b8f-be86-502ff8366039 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:22:26.505354 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG oslo_concurrency.lockutils [None req-0e537d41-68fa-4b8f-be86-502ff8366039 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:22:26.506138 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG oslo_concurrency.lockutils [None req-0e537d41-68fa-4b8f-be86-502ff8366039 admin admin] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:22:26.507094 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG oslo_concurrency.lockutils [None req-0e537d41-68fa-4b8f-be86-502ff8366039 admin admin] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:22:26.531365 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-0e537d41-68fa-4b8f-be86-502ff8366039 admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081752 Feb 15 14:22:26.531846 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 38/75] 10.222.0.83 () {60 vars in 1193 bytes} [Tue Feb 15 14:22:26 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:22:27.833732 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: DEBUG nova.api.openstack.wsgi [None req-cc2987b2-a6e2-45e6-9156-625967b6fbe9 admin admin] Calling method '>' {{(pid=101917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:22:27.835344 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: INFO nova.api.openstack.requestlog [None req-cc2987b2-a6e2-45e6-9156-625967b6fbe9 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Feb 15 14:22:27.835741 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: [pid: 101917|app: 0|req: 38/76] 10.222.0.83 () {56 vars in 1074 bytes} [Tue Feb 15 14:22:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:22:28.030159 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-580927c4-d0da-4a1b-bc24-4fe2d56d631d admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:22:28.031304 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:22:28.031304 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: warnings.warn(msg) Feb 15 14:22:28.032863 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG oslo_concurrency.lockutils [None req-580927c4-d0da-4a1b-bc24-4fe2d56d631d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:22:28.033304 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG oslo_concurrency.lockutils [None req-580927c4-d0da-4a1b-bc24-4fe2d56d631d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:22:28.034100 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG oslo_concurrency.lockutils [None req-580927c4-d0da-4a1b-bc24-4fe2d56d631d admin admin] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:22:28.034522 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: DEBUG oslo_concurrency.lockutils [None req-580927c4-d0da-4a1b-bc24-4fe2d56d631d admin admin] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:22:28.055699 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-580927c4-d0da-4a1b-bc24-4fe2d56d631d admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078047 Feb 15 14:22:28.056249 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 39/77] 10.222.0.83 () {60 vars in 1193 bytes} [Tue Feb 15 14:22:27 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 14:23:30.118950 dv-cinder-819149-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 15 14:23:30.121338 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: Tue Feb 15 14:23:30 2022 - graceful shutdown triggered... Feb 15 14:23:30.121849 dv-cinder-819149-3-iscsi devstack@n-api.service[101917]: Gracefully killing worker 1 (pid: 101917)... Feb 15 14:23:30.122227 dv-cinder-819149-3-iscsi devstack@n-api.service[101918]: Gracefully killing worker 2 (pid: 101918)... Feb 15 14:23:31.120697 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: worker 1 buried after 1 seconds Feb 15 14:23:31.120697 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: worker 2 buried after 1 seconds Feb 15 14:23:31.120697 dv-cinder-819149-3-iscsi devstack@n-api.service[101916]: goodbye to uWSGI. Feb 15 14:23:31.122255 dv-cinder-819149-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Feb 15 14:23:31.122833 dv-cinder-819149-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 15 14:23:31.125570 dv-cinder-819149-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 15 14:23:31.141899 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 15 14:23:31.143762 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Feb 15 14:23:31 2022] *** Feb 15 14:23:31.143762 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 15 14:23:31.143762 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 15 14:23:31.143762 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: nodename: dv-cinder-819149-3-iscsi Feb 15 14:23:31.143762 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: machine: x86_64 Feb 15 14:23:31.143762 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: clock source: unix Feb 15 14:23:31.143762 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: pcre jit disabled Feb 15 14:23:31.143762 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: detected number of CPU cores: 4 Feb 15 14:23:31.143762 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: current working directory: / Feb 15 14:23:31.143762 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: detected binary path: /usr/bin/uwsgi-core Feb 15 14:23:31.144846 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: your processes number limit is 47680 Feb 15 14:23:31.144846 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: your memory page size is 4096 bytes Feb 15 14:23:31.144846 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: detected max file descriptor number: 2048 Feb 15 14:23:31.144846 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: lock engine: pthread robust mutexes Feb 15 14:23:31.144846 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: thunder lock: enabled Feb 15 14:23:31.144846 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 15 14:23:31.144846 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 15 14:23:31.192860 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: Python main interpreter initialized at 0x55d8bbca79c0 Feb 15 14:23:31.192860 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: python threads support enabled Feb 15 14:23:31.192860 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: your server socket listen backlog is limited to 100 connections Feb 15 14:23:31.192860 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: your mercy for graceful operations on workers is 90 seconds Feb 15 14:23:31.193789 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: mapped 403077 bytes (393 KB) for 2 cores Feb 15 14:23:31.193929 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: *** Operational MODE: preforking *** Feb 15 14:23:31.194233 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: *** uWSGI is running in multiple interpreter mode *** Feb 15 14:23:31.194233 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: spawned uWSGI master process (pid: 116345) Feb 15 14:23:31.196687 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: spawned uWSGI worker 1 (pid: 116362, cores: 1) Feb 15 14:23:31.196687 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: spawned uWSGI worker 2 (pid: 116363, cores: 1) Feb 15 14:23:31.194454 dv-cinder-819149-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 15 14:23:31.196971 dv-cinder-819149-3-iscsi devstack@n-api.service[116345]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 15 14:23:33.098142 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 14:23:33.098142 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: from cryptography.utils import int_from_bytes Feb 15 14:23:33.099137 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 14:23:33.099137 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: from cryptography.utils import int_from_bytes Feb 15 14:23:33.134271 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 14:23:33.134271 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: from cryptography.utils import int_from_bytes Feb 15 14:23:33.134860 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 14:23:33.134860 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: from cryptography.utils import int_from_bytes Feb 15 14:23:35.619444 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 15 14:23:35.619994 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 15 14:23:35.620195 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 15 14:23:35.620587 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 15 14:23:35.620848 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 15 14:23:35.621236 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.621619 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.621937 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.622306 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.622721 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.622953 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.623419 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.623749 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.624078 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.624344 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.624693 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.625023 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-3-iscsi {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.625350 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.625662 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.625974 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.626296 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.626603 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.626926 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.627234 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.627737 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.629599 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.629599 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.629599 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.629901 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.630293 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.630658 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.630992 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.631346 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.631670 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.631981 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.632388 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-3-iscsi {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.632731 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.633163 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.633992 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.634408 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.634934 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.635452 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.635787 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.636260 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.636628 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.636961 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.637347 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.637704 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.638071 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.638404 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.638764 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.639654 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.639654 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.639851 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.640046 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.640304 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.640677 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.641007 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.641335 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.641660 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.641916 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.642171 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.642496 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.642820 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.643132 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.643445 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.643760 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.644071 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.644446 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.645342 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.645661 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 15 14:23:35.646079 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.646178 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 15 14:23:35.646263 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.646424 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 15 14:23:35.646520 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.646673 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.646763 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 15 14:23:35.646885 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 15 14:23:35.646996 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.647196 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.647304 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.647521 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.647614 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.647916 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.648006 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.648179 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.648273 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.648503 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.648612 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.648848 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.648939 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.649172 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.649273 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.649485 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.649592 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.649811 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.649916 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.650098 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.650204 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.650420 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.650519 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.650727 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.650825 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-3-iscsi {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.651037 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.651137 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.651363 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.651463 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.651677 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.651773 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.651987 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.652088 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.652242 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.652343 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.652569 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.652670 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.652879 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.652980 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.653200 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.653440 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.653544 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.653759 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.653908 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.654074 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.654191 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.654387 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.654479 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.654693 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.654854 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.655000 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.655122 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.655319 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.655444 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.655629 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.655748 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.655940 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.656047 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.656248 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.656357 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.656596 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.656714 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.656904 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.657063 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-3-iscsi {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.657212 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.657320 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.657536 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.657641 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.657861 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.657954 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.658173 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.658324 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.658486 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.658643 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.658797 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.658957 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.659106 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.659288 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.659430 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.659619 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.659739 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.659937 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.660092 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.660292 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.660393 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.660657 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.660763 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.660984 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.661102 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.661313 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.661453 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.661613 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.661762 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.661943 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.662048 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.662258 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.662353 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.662584 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.662703 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.662924 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.663161 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.663275 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.663476 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.663588 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.663763 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.663861 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.664052 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.664159 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.664384 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.664519 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.664729 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.664838 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.665044 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.665159 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.665308 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.665400 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.665551 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.665902 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.666132 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.666242 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.666458 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.666626 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.666954 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.667084 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.667270 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.667559 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.667729 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.667895 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.668066 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.668225 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.668387 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.668717 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.668717 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.668966 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.669056 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.669140 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.669246 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.669390 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.669488 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.669640 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.669785 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.669980 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.670120 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.670315 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.670421 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.670636 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.670745 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.670955 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.671120 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.671268 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.671368 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.671603 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.671759 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.671914 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.672020 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.672227 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.672328 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.672562 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.672658 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.672884 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.672978 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.673206 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.673298 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.673539 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.673631 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.673857 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.673960 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.674172 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.674265 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.674493 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.674599 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.674805 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.674907 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.675117 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.675208 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.675374 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.675466 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.676221 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.676378 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.676660 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.676761 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.676975 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.677079 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.677308 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.677400 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.677624 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.677724 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.677940 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.678043 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.678249 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.678340 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.678561 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.678651 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.678874 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.678973 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.679183 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.679273 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.679496 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.679594 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.679812 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.679903 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.680124 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.680252 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.680467 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.680593 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.680773 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.680866 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.681082 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.681171 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.681391 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.681491 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.681704 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.681799 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.682016 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.682108 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.682326 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.682425 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.682640 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.682739 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.682953 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.683052 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.683264 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.683362 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.683581 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.683671 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.683892 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.683982 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.684204 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.684302 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.684537 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.684639 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.684847 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.684941 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.685151 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.685282 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.685461 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.685568 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.685772 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.685883 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.686076 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.686166 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.686390 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.686481 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.686714 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.686854 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.687016 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.687118 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.687330 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.687428 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.687641 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.687741 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.687949 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.688048 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.688254 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.688351 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.688585 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.688687 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.688892 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.689037 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.689198 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.689298 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.689507 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.689599 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.689810 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.689945 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.690152 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.690312 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.690470 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.690569 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.690782 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.690908 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.691142 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.691289 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.691496 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.691665 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.691787 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 14:23:35.691980 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.692136 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.692301 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.692483 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.692643 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.692837 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.692957 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.693160 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.693294 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.693499 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.693638 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.693849 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.693980 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.694158 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.694289 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.694476 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.694594 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.694820 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.694970 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.695099 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.695212 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.695509 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.695647 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.695759 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.696046 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.696370 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.696762 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.697012 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.697214 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.697360 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.697488 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.697680 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.697813 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.698006 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.698133 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.698323 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.698459 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.698646 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.698767 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.698980 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.699110 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.699305 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.699435 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.699621 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.699740 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.699963 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.700089 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.700286 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.700517 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.700654 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.700958 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.701100 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.701324 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.701545 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.701692 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.701900 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.702085 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.702218 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.702528 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.702675 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.702855 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.703020 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.703175 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.703461 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.703595 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.703801 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.703935 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.704120 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.704454 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.704607 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.704775 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.705001 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.705202 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.705416 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.705550 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.705734 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.706053 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.706198 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.706371 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.706578 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.706712 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.707599 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.707773 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.707915 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.708129 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.708293 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.708491 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.708755 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.708904 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.709066 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.709305 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.709438 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.709678 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.709811 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.710004 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.710253 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.710395 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.710649 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.710879 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.711016 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.711269 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.711416 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.711619 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.711829 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.711971 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.712186 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.712334 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.712521 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.712801 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.712959 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.713140 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.713314 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.713449 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.713757 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.713899 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.714069 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.714262 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.714424 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.714692 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.714825 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.715008 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.715240 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.715385 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.715619 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.715761 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.715933 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.716250 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.716383 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.716597 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.716831 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.716966 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.717232 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.717373 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.717591 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.717895 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.718040 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.718207 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.718350 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.718517 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.718789 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.718933 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.719162 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.719301 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.719482 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.719725 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.719867 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.720090 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.720223 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.720428 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.720760 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.720911 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.721165 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.721358 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.721518 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.721738 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.721903 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.722038 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.722207 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.722407 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.723287 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.723604 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.723754 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.723949 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.724092 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.724267 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.724560 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.724709 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.724907 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.725040 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.725224 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.725500 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.725638 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.725877 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.726052 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.726228 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.726573 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.726715 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.726903 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.727077 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.727236 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.727524 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.727674 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.727905 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.728184 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.728338 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.728525 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.728685 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.728841 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.728996 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.729148 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.729299 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.729452 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.729610 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.729755 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.729900 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.730053 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.730219 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.730372 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.730532 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.730686 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.730857 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.731089 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.731248 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.731403 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.731547 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.731718 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.731933 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.732084 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.732241 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.732431 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.732585 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.732741 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.732886 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.733031 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.733182 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.733347 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.733493 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.733645 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.733797 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.733942 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.734094 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.734258 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.734404 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.734548 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.734700 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.734853 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.734998 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.735152 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.735304 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.735474 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.735695 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.735861 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.736015 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.736170 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.736325 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.736514 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.736663 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.736827 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.736987 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.737148 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.737303 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.737448 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.737591 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.737734 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.737905 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.738175 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.738480 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.738650 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.738797 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.738951 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.739111 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.739257 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.739402 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.739546 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.739690 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.739918 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.740073 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.740218 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.740371 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.740565 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.740731 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.740886 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.741038 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.741278 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.741428 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.741573 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.741725 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.741725 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.742098 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.742249 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.742394 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.742539 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.742702 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.742857 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.743002 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.743154 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.743317 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.743470 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.743624 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.743771 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.743914 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.744066 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.744218 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.744370 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.744560 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.744717 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.744717 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.745185 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.745339 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.745547 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.745822 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.745958 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.745958 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.746214 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.746354 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.746486 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.746627 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.746759 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.746888 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.747286 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.747533 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.747896 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.748177 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.748349 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.748661 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.748818 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.748979 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.749133 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.749340 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.749503 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.749651 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.749820 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.749965 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.750116 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.750297 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.750450 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.750609 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.750761 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.750914 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.751060 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.751206 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.751490 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.751651 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.751817 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.751978 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.752145 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.752364 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.752559 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.752720 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.752866 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.753019 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.753171 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.753324 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.753487 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.753647 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.753850 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.754061 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.754349 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.754551 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.754699 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.754860 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.755017 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.755315 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.755485 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.755678 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.755852 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.756227 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.756384 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.756613 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.756809 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.757143 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.757306 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.757455 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.757606 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.757752 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.757894 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.758076 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.758255 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.758488 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.758658 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.758897 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.759055 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.759223 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.759368 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.759715 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.759909 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.760069 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.760182 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.760305 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.760575 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.760786 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.760947 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.761102 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.761310 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.761582 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.761814 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.761971 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.762143 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.762306 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.762575 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.762742 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.762888 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.763034 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.763188 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.763335 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.763481 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.763627 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.763791 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.763975 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.764104 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.764226 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.764559 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.764731 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.764899 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.765221 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.765389 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.765546 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.765692 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.765837 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.765981 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.766235 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.766441 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.766604 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.766758 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.766904 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.767057 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.767216 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.767363 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.767582 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.767739 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.767892 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.768038 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.768222 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.768455 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.768685 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.768836 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.769134 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.769294 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.769987 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.770139 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.770315 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.770554 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.770768 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.771094 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.771273 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.771442 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.771608 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.771608 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.771993 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.771993 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.772288 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.772515 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.772741 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.772905 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.773052 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.773207 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.773361 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.773515 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.773671 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.773816 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.773969 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.774198 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.774353 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.774513 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.774671 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.774818 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.774974 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.775128 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.775273 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.775418 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.775569 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.775728 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.775887 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.776042 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.776213 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.776461 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.776624 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.776778 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.776942 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.777089 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.777233 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.777385 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.777385 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.777669 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.777839 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.777992 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.778146 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.778299 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.778452 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.778607 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.778853 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.779021 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.779277 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.779438 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.779669 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.779832 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.779997 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.780143 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.780296 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.780460 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.780623 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.780779 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.780933 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.780933 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.781216 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.781362 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.781506 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.781660 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.781831 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.782063 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.782215 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.782371 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.782527 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.782675 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.782902 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.783063 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.783209 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.783362 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.783517 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.783669 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.783816 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.783967 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.784168 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.784320 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.784511 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.784664 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.784809 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.785072 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.785837 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.786049 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.786216 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.786371 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.786371 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.786743 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.786897 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.787054 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.787209 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.787355 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.787500 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.787644 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.787787 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.787941 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.788094 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.788094 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.788376 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.788581 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.788729 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.788979 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.789152 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.789315 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.789555 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.789709 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.789855 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.790014 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.790209 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.790360 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.790513 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.790929 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.791078 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.791233 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.791404 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.791559 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.791706 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.791888 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.792065 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.792299 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.792491 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.792652 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.792800 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.793041 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.793203 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.793357 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.793357 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.793357 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.793357 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.793357 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.793357 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.794185 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.794338 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.794501 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.794650 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.794802 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.794969 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.795117 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.795271 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.795494 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.795656 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.795811 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.795960 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.795960 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.796232 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.796377 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.796593 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.796829 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.796989 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.797142 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.797287 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.797432 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.797584 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.797756 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.797902 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.798055 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.798208 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.798360 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.798360 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.798645 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.798797 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.798968 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.799197 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.799349 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.799509 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.799782 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.799935 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.800089 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.800235 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.800380 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.800562 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.800745 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.800892 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.801038 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.801198 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.801344 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.801344 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.801640 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.801795 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.801941 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.802085 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.802238 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.802552 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.802712 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.802867 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.803031 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.803252 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.803414 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.803414 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.803707 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.803854 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.803854 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.804155 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.804385 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.804727 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.805039 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.805364 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.805685 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.805945 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.806109 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.806327 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.806479 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.806627 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.806809 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.807051 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.807215 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.807369 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.807546 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.807699 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.807902 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.808064 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.808253 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.808458 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.808623 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.808769 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.808914 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.809080 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.809322 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.809483 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.809640 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.809813 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.810057 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.810218 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.810365 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.810510 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.810655 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.810801 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.810954 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.811114 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.811271 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.811416 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.811563 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.811708 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.811868 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.812013 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.812166 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.812369 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.812634 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.812796 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.812942 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.813105 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.813427 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.813598 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.813756 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.813910 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.814056 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.814200 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.814345 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.814496 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.814651 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.814798 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.814958 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.815107 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.815252 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.815414 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.815573 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.815720 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.815873 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.816027 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.816179 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.816387 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.816615 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.816761 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.816908 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.817083 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.817302 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.817538 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.817723 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.817882 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.818030 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.818186 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.818340 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.818501 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.818655 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.818811 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.818959 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.819113 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.819259 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.819508 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.819661 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.819826 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.819973 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.820119 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.820265 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.820448 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.820704 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.820856 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.821010 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.821165 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.821320 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.821547 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.821710 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.821865 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.822030 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.822229 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.822391 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.822539 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.822865 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.823021 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.823021 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.823309 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.823560 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.823719 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.823879 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.823879 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.824173 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.824329 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.824526 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.824675 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.824820 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.824976 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.825129 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.825295 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.825442 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.825587 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.825740 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.825886 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.826045 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.826287 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.826438 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.826584 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.826729 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.826873 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.827019 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.827179 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.827179 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.827568 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.827568 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.827865 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.827865 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.828168 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.828326 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.828496 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.828644 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.828801 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.828961 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.829110 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.829266 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.829421 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.829673 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.829835 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.829998 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.830150 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.830305 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.830460 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.830614 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.830886 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.831062 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.831217 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.831369 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.831520 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.831672 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.831832 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.832589 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.832748 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.832996 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.833167 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.833320 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.833480 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.833480 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.833875 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.833875 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.834164 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.834316 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.834477 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.834630 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.834794 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.834954 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.835105 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.835268 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.835439 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.835603 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.835765 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.835926 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.836085 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.836244 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.836425 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.836585 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.836737 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.836889 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.837040 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.837208 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.837379 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.837550 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.837782 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.837950 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.838103 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.838269 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.838269 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.838573 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.838725 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.838877 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.839028 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.839187 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.839348 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.839512 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.839683 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.839683 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.840054 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.840221 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.840374 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.840567 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.840720 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.840906 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.841169 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.841330 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.841482 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.841651 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.841826 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.841989 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.842156 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.842317 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.842470 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.842635 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.842796 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.842973 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.843219 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.843380 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.843533 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.843533 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.843935 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.844106 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.844273 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.844446 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.844607 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.844607 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.844915 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.845083 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.845253 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.845411 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.845571 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.845723 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.845886 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.846048 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.846200 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.846357 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.846509 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.846673 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.846836 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.846990 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.847154 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.847317 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.847470 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.848205 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.848472 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.848637 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.848797 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.848958 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.849122 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.849283 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.849447 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.849608 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.849608 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.849918 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.850155 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.850327 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.850501 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.850659 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.850821 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.850974 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.851154 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.851412 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.851582 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.851737 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.851908 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.852062 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.852228 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.852373 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.852564 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.852719 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.852882 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.853042 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.853042 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.853478 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.853478 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.853782 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.853782 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.854183 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.854183 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.854509 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.854676 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.854836 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.854990 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.855152 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.855408 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.855575 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.855741 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.855895 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.856047 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.856213 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.856374 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.856573 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.856738 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.856902 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.857065 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.857227 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.857227 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.857517 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.857676 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.857831 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.857991 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.858144 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.858296 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.858466 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.858690 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.858860 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.859026 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.859181 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.859341 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.859495 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.859495 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.859790 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.859954 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.859954 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.860339 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.860523 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.860677 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.860831 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.861074 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.861074 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.861402 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.861660 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.861830 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.861995 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.862150 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.862310 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.862471 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.862638 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.862793 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.862955 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.863145 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.863326 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.863498 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.863768 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.863985 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.864179 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.864460 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.864639 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.864802 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.864802 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.865118 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.865298 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.865451 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.865611 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.865786 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.865947 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.866114 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.866269 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.866429 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.866641 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.866800 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.866961 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.867125 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.867295 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.867449 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.867610 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.867610 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.867610 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.867610 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.868220 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.868220 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.868551 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.868731 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.869046 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.869358 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.869668 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.869986 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.870310 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.870607 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.870917 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.871225 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.871543 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.871850 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.872165 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.872494 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.872682 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.872839 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.873029 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.873189 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.873379 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.873540 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.873721 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.873967 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.874138 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.874293 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.874542 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.874711 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.874880 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.875041 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.875195 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.875354 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.875578 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.875897 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.876213 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.876593 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.876918 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.877488 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.877829 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.878155 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.878494 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.879128 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.879444 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.879757 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.880190 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.880496 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.880770 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.880932 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.881112 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.881267 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.881436 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.881589 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.881752 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.882023 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.882196 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.882365 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.882520 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.882673 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.882831 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.882994 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.882994 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.883316 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.883471 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.883624 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.883776 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.883946 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.884197 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.884365 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.884670 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.884841 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.885080 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.885080 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.885576 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.885853 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.886117 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.886367 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.886537 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.886692 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.886855 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.887018 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.887173 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.887335 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.887335 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.887626 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.887788 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.887788 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.888098 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.888251 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.888434 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.888607 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.888776 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.888938 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.889116 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.889347 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.889506 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.889669 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.889836 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.889991 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.890155 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.890309 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.890463 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.893509 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.893732 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.893903 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.894074 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.894334 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.895095 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.895282 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.895443 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.895599 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.895599 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.895599 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.895599 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.895599 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.895599 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.896531 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.896690 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.896843 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.897010 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.897010 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.897301 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.897454 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.897608 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.897772 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.897940 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.898102 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.898255 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.898417 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.898578 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.898741 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.898915 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.899083 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.899244 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.899496 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.899496 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.899816 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.899971 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.900132 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.900286 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.900460 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.900621 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.900883 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.901044 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.901216 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.901449 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.901619 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.901773 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.901940 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.902109 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.902269 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.902431 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.902584 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.902749 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.902904 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.903066 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.903233 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.903387 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.903566 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.903824 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.903985 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.904158 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.904158 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.904590 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.904763 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.904933 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.905107 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.905332 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.905489 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.905643 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.905806 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.906541 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.906714 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.906880 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.907037 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.907189 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.907349 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.907502 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.907680 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.907847 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.908001 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.908155 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.908315 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.908493 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.908746 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.908918 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.909078 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.909233 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.909387 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.909387 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.909792 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.909955 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.910678 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.910870 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.911123 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.911295 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.911484 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.911738 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.911906 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.912068 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.912222 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.912386 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.912582 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.912738 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.912891 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.913045 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.913197 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.913197 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.913514 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.913679 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.913851 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 15 14:23:35.914148 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.914148 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.914148 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.914148 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.914148 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.914148 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.914148 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.914148 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.915539 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.915539 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.915539 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.915539 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.915539 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.915539 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.915539 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.915539 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.917019 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.917019 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.917019 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.917019 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.917019 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.917019 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.917019 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.918029 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.918029 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.918029 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.918463 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.918622 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.918833 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.919174 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.919537 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.919860 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.920521 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.924498 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.924498 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.924498 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.924498 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 14:23:35.924498 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 15 14:23:35.932388 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_db.sqlalchemy.engines [None req-a732ddbd-caaa-46c0-ab3b-3d7bb3698d39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116363) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 14:23:35.945697 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_db.sqlalchemy.engines [None req-71bbdc7a-6283-404f-8af1-cc7da3325488 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 14:23:35.996573 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.context [None req-a732ddbd-caaa-46c0-ab3b-3d7bb3698d39 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f90dd206-7018-4083-9442-b93ea6e9dfe9(cell1) {{(pid=116363) load_cells /opt/stack/nova/nova/context.py:464}} Feb 15 14:23:36.000782 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a732ddbd-caaa-46c0-ab3b-3d7bb3698d39 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:23:36.002363 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a732ddbd-caaa-46c0-ab3b-3d7bb3698d39 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:23:36.003178 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a732ddbd-caaa-46c0-ab3b-3d7bb3698d39 None None] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:23:36.005406 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a732ddbd-caaa-46c0-ab3b-3d7bb3698d39 None None] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:23:36.012674 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.context [None req-71bbdc7a-6283-404f-8af1-cc7da3325488 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f90dd206-7018-4083-9442-b93ea6e9dfe9(cell1) {{(pid=116362) load_cells /opt/stack/nova/nova/context.py:464}} Feb 15 14:23:36.015934 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_db.sqlalchemy.engines [None req-a732ddbd-caaa-46c0-ab3b-3d7bb3698d39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116363) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 14:23:36.017125 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-71bbdc7a-6283-404f-8af1-cc7da3325488 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:23:36.017361 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_db.sqlalchemy.engines [None req-a732ddbd-caaa-46c0-ab3b-3d7bb3698d39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116363) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 14:23:36.018739 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-71bbdc7a-6283-404f-8af1-cc7da3325488 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:23:36.020332 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-71bbdc7a-6283-404f-8af1-cc7da3325488 None None] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:23:36.022349 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-71bbdc7a-6283-404f-8af1-cc7da3325488 None None] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:23:36.033523 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_db.sqlalchemy.engines [None req-71bbdc7a-6283-404f-8af1-cc7da3325488 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 14:23:36.037042 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_db.sqlalchemy.engines [None req-71bbdc7a-6283-404f-8af1-cc7da3325488 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 14:23:36.185700 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_db.sqlalchemy.engines [None req-a732ddbd-caaa-46c0-ab3b-3d7bb3698d39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116363) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 14:23:36.196676 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_db.sqlalchemy.engines [None req-71bbdc7a-6283-404f-8af1-cc7da3325488 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 14:23:36.623581 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: WARNING keystonemiddleware.auth_token [None req-a732ddbd-caaa-46c0-ab3b-3d7bb3698d39 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 15 14:23:36.630608 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: WARNING keystonemiddleware.auth_token [None req-a732ddbd-caaa-46c0-ab3b-3d7bb3698d39 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 15 14:23:36.635862 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: WARNING keystonemiddleware.auth_token [None req-71bbdc7a-6283-404f-8af1-cc7da3325488 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 15 14:23:36.642356 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: WARNING keystonemiddleware.auth_token [None req-71bbdc7a-6283-404f-8af1-cc7da3325488 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 15 14:23:36.857051 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: WARNING keystonemiddleware.auth_token [None req-a732ddbd-caaa-46c0-ab3b-3d7bb3698d39 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 15 14:23:36.862773 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: WARNING keystonemiddleware.auth_token [None req-a732ddbd-caaa-46c0-ab3b-3d7bb3698d39 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 15 14:23:36.868489 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d8bbca79c0 pid: 116363 (default app) Feb 15 14:23:36.870092 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: WARNING keystonemiddleware.auth_token [None req-71bbdc7a-6283-404f-8af1-cc7da3325488 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 15 14:23:36.875358 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: WARNING keystonemiddleware.auth_token [None req-71bbdc7a-6283-404f-8af1-cc7da3325488 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 15 14:23:36.881678 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d8bbca79c0 pid: 116362 (default app) Feb 15 14:24:11.942963 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-337b4e91-0018-4d6a-a9af-fe98a5f18908 tempest-VolumesGetTestJSON-1252241284 tempest-VolumesGetTestJSON-1252241284-project] Action: 'create', calling method: .version_select at 0x7fd7555a75e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1086559498", "metadata": {"Type": "work"}}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:24:13.574309 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-337b4e91-0018-4d6a-a9af-fe98a5f18908 tempest-VolumesGetTestJSON-1252241284 tempest-VolumesGetTestJSON-1252241284-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.413291 Feb 15 14:24:13.575210 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 1/1] 10.222.0.83 () {60 vars in 1155 bytes} [Tue Feb 15 14:24:11 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2416 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 15 14:24:13.814758 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-15e4b45c-7d5b-4f36-ae89-42d24d6a908a tempest-VolumesGetTestJSON-1252241284 tempest-VolumesGetTestJSON-1252241284-project] Calling method '.version_select at 0x7fd7555ef280>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:14.276616 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-6c3bfd96-2136-48b2-ac2b-27b94638dce2 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] Action: 'create', calling method: .version_select at 0x7fd7554d71f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-317044412"}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:24:14.929051 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-15e4b45c-7d5b-4f36-ae89-42d24d6a908a tempest-VolumesGetTestJSON-1252241284 tempest-VolumesGetTestJSON-1252241284-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/141266f6-601e-482d-a1a2-4b6b78a02d11" status: 200 len: 354 microversion: 2.1 time: 1.344599 Feb 15 14:24:14.929706 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 1/2] 10.222.0.83 () {58 vars in 1244 bytes} [Tue Feb 15 14:24:13 2022] GET /compute/v2.1/os-volumes/141266f6-601e-482d-a1a2-4b6b78a02d11 => generated 354 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:24:15.000095 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-6c3bfd96-2136-48b2-ac2b-27b94638dce2 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.143423 Feb 15 14:24:15.001131 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 2/3] 10.222.0.83 () {60 vars in 1154 bytes} [Tue Feb 15 14:24:13 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1145 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Feb 15 14:24:15.139897 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-fc2a54a4-5113-4531-9a7f-b20e810f6c72 tempest-VolumesNegativeTest-746208497 tempest-VolumesNegativeTest-746208497-project] Action: 'create', calling method: .version_select at 0x7fd7555fdd30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1580147915", "metadata": {"Type": "work"}}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:24:15.142359 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-fc2a54a4-5113-4531-9a7f-b20e810f6c72 tempest-VolumesNegativeTest-746208497 tempest-VolumesNegativeTest-746208497-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:24:15.144076 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-fc2a54a4-5113-4531-9a7f-b20e810f6c72 tempest-VolumesNegativeTest-746208497 tempest-VolumesNegativeTest-746208497-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.213000 Feb 15 14:24:15.144766 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 2/4] 10.222.0.83 () {60 vars in 1155 bytes} [Tue Feb 15 14:24:14 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 215 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 15 14:24:15.157206 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-4c661c51-2b8b-47b7-9930-6353cfaaf603 tempest-VolumesGetTestJSON-1252241284 tempest-VolumesGetTestJSON-1252241284-project] Calling method '.version_select at 0x7fd7554b9c10>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:15.235589 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-26fbe648-dc96-42b3-ae9e-caea24aada6b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1309936333", "imageRef": "da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53", "flavorRef": "452", "networks": [{"uuid": "bb6159d9-9ae2-46b1-bd5a-7e09efb47fc5"}]}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:24:15.242291 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-4c661c51-2b8b-47b7-9930-6353cfaaf603 tempest-VolumesGetTestJSON-1252241284 tempest-VolumesGetTestJSON-1252241284-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/141266f6-601e-482d-a1a2-4b6b78a02d11" status: 200 len: 354 microversion: 2.1 time: 0.090375 Feb 15 14:24:15.245567 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 3/5] 10.222.0.83 () {58 vars in 1244 bytes} [Tue Feb 15 14:24:15 2022] GET /compute/v2.1/os-volumes/141266f6-601e-482d-a1a2-4b6b78a02d11 => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:24:15.258211 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-e12e428d-74d5-4fed-9585-8c1c5cdd0790 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] Calling method '.version_select at 0x7fd755484550>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:15.344141 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-e12e428d-74d5-4fed-9585-8c1c5cdd0790 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/fe32d5fe-3490-4568-98b9-c55e355863a2" status: 200 len: 344 microversion: 2.1 time: 0.097527 Feb 15 14:24:15.344872 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 4/6] 10.222.0.83 () {58 vars in 1244 bytes} [Tue Feb 15 14:24:15 2022] GET /compute/v2.1/os-volumes/fe32d5fe-3490-4568-98b9-c55e355863a2 => generated 344 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:24:15.350729 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-9b62903f-ed4d-4073-a68d-6353f5069d8f tempest-VolumesNegativeTest-746208497 tempest-VolumesNegativeTest-746208497-project] Action: 'create', calling method: .version_select at 0x7fd7554b9d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1951207640", "metadata": {"Type": "work"}}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:24:15.352198 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-9b62903f-ed4d-4073-a68d-6353f5069d8f tempest-VolumesNegativeTest-746208497 tempest-VolumesNegativeTest-746208497-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:24:15.354567 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-9b62903f-ed4d-4073-a68d-6353f5069d8f tempest-VolumesNegativeTest-746208497 tempest-VolumesNegativeTest-746208497-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007063 Feb 15 14:24:15.356420 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 5/7] 10.222.0.83 () {60 vars in 1155 bytes} [Tue Feb 15 14:24:15 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 15 14:24:15.369152 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-c7f95a9b-24f3-4583-857c-a912435b4812 tempest-VolumesGetTestJSON-1252241284 tempest-VolumesGetTestJSON-1252241284-project] Calling method '.version_select at 0x7fd755484430>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:15.488020 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.network.neutron [None req-26fbe648-dc96-42b3-ae9e-caea24aada6b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] validate_networks() for [('bb6159d9-9ae2-46b1-bd5a-7e09efb47fc5', None, None, None, None, None)] {{(pid=116363) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 14:24:15.538830 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-c7f95a9b-24f3-4583-857c-a912435b4812 tempest-VolumesGetTestJSON-1252241284 tempest-VolumesGetTestJSON-1252241284-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/141266f6-601e-482d-a1a2-4b6b78a02d11" status: 202 len: 0 microversion: 2.1 time: 0.181015 Feb 15 14:24:15.540016 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 6/8] 10.222.0.83 () {58 vars in 1247 bytes} [Tue Feb 15 14:24:15 2022] DELETE /compute/v2.1/os-volumes/141266f6-601e-482d-a1a2-4b6b78a02d11 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:24:15.553148 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-866c2941-337b-4765-88b5-74e9b852310a tempest-VolumesNegativeTest-746208497 tempest-VolumesNegativeTest-746208497-project] Action: 'create', calling method: .version_select at 0x7fd755484670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2030768197", "metadata": {"Type": "work"}}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:24:15.559033 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-866c2941-337b-4765-88b5-74e9b852310a tempest-VolumesNegativeTest-746208497 tempest-VolumesNegativeTest-746208497-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:24:15.560805 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-866c2941-337b-4765-88b5-74e9b852310a tempest-VolumesNegativeTest-746208497 tempest-VolumesNegativeTest-746208497-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018604 Feb 15 14:24:15.561384 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 7/9] 10.222.0.83 () {60 vars in 1155 bytes} [Tue Feb 15 14:24:15 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 15 14:24:15.659324 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-53de2d14-2fb1-4544-95d2-dbe0b0874825 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1252149436", "imageRef": "da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53", "flavorRef": "452", "networks": [{"uuid": "eff5572c-5ad3-47ef-8854-8018b7c6065d"}]}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:24:15.770657 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.network.neutron [None req-53de2d14-2fb1-4544-95d2-dbe0b0874825 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] validate_networks() for [('eff5572c-5ad3-47ef-8854-8018b7c6065d', None, None, None, None, None)] {{(pid=116362) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 14:24:16.780141 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-26fbe648-dc96-42b3-ae9e-caea24aada6b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Flavor limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 14:24:16.781236 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-26fbe648-dc96-42b3-ae9e-caea24aada6b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Image limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 14:24:16.781859 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-26fbe648-dc96-42b3-ae9e-caea24aada6b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Flavor pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 14:24:16.782399 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-26fbe648-dc96-42b3-ae9e-caea24aada6b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Image pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 14:24:16.782964 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-26fbe648-dc96-42b3-ae9e-caea24aada6b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 14:24:16.813703 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-26fbe648-dc96-42b3-ae9e-caea24aada6b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:16.814724 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-26fbe648-dc96-42b3-ae9e-caea24aada6b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:16.816143 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-26fbe648-dc96-42b3-ae9e-caea24aada6b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:16.819300 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-26fbe648-dc96-42b3-ae9e-caea24aada6b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:16.895634 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-26fbe648-dc96-42b3-ae9e-caea24aada6b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Getting quotas for project 5e65b7a785c846f084db5bc9e8b70b8f. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:24:16.912499 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-26fbe648-dc96-42b3-ae9e-caea24aada6b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Getting quotas for user ee6049bcdd6941458f715d9678b40f98 and project 5e65b7a785c846f084db5bc9e8b70b8f. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:24:16.923176 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-53de2d14-2fb1-4544-95d2-dbe0b0874825 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Flavor limits 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 14:24:16.927424 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-53de2d14-2fb1-4544-95d2-dbe0b0874825 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Image limits 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 14:24:16.929631 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-53de2d14-2fb1-4544-95d2-dbe0b0874825 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Flavor pref 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 14:24:16.932911 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-53de2d14-2fb1-4544-95d2-dbe0b0874825 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Image pref 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 14:24:16.933930 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-53de2d14-2fb1-4544-95d2-dbe0b0874825 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 14:24:16.937178 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-26fbe648-dc96-42b3-ae9e-caea24aada6b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Going to run 1 instances... {{(pid=116363) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 14:24:16.941143 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-26fbe648-dc96-42b3-ae9e-caea24aada6b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 14:24:16.963992 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-53de2d14-2fb1-4544-95d2-dbe0b0874825 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:16.965910 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-53de2d14-2fb1-4544-95d2-dbe0b0874825 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:16.970154 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-53de2d14-2fb1-4544-95d2-dbe0b0874825 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:16.972352 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-53de2d14-2fb1-4544-95d2-dbe0b0874825 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:17.045672 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-53de2d14-2fb1-4544-95d2-dbe0b0874825 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Getting quotas for project b003f1ecbf4e4a32a99159d5b18a98ec. Resources: {'instances', 'ram', 'cores'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:24:17.059695 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-53de2d14-2fb1-4544-95d2-dbe0b0874825 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Getting quotas for user 9b50593d13054c9c8fdf463566f36b2e and project b003f1ecbf4e4a32a99159d5b18a98ec. Resources: {'instances', 'ram', 'cores'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:24:17.088464 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-53de2d14-2fb1-4544-95d2-dbe0b0874825 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Going to run 1 instances... {{(pid=116362) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 14:24:17.092151 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-53de2d14-2fb1-4544-95d2-dbe0b0874825 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 14:24:17.177213 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-26fbe648-dc96-42b3-ae9e-caea24aada6b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.166352 Feb 15 14:24:17.180160 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 3/10] 10.222.0.83 () {60 vars in 1146 bytes} [Tue Feb 15 14:24:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 14:24:17.186998 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-e1e16a37-b98f-425f-8182-7924f111438c tempest-VolumesGetTestJSON-1252241284 tempest-VolumesGetTestJSON-1252241284-project] Calling method '.version_select at 0x7fd755383a60>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:17.225400 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-53de2d14-2fb1-4544-95d2-dbe0b0874825 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.662949 Feb 15 14:24:17.233005 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.wsgi [None req-e1e16a37-b98f-425f-8182-7924f111438c tempest-VolumesGetTestJSON-1252241284 tempest-VolumesGetTestJSON-1252241284-project] HTTP exception thrown: Volume 141266f6-601e-482d-a1a2-4b6b78a02d11 could not be found. Feb 15 14:24:17.233619 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-e1e16a37-b98f-425f-8182-7924f111438c tempest-VolumesGetTestJSON-1252241284 tempest-VolumesGetTestJSON-1252241284-project] Returning 404 to user: Volume 141266f6-601e-482d-a1a2-4b6b78a02d11 could not be found. {{(pid=116363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:24:17.234475 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-e1e16a37-b98f-425f-8182-7924f111438c tempest-VolumesGetTestJSON-1252241284 tempest-VolumesGetTestJSON-1252241284-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/141266f6-601e-482d-a1a2-4b6b78a02d11" status: 404 len: 109 microversion: 2.1 time: 0.052805 Feb 15 14:24:17.235394 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 8/11] 10.222.0.83 () {60 vars in 1146 bytes} [Tue Feb 15 14:24:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 14:24:17.242097 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 4/12] 10.222.0.83 () {58 vars in 1244 bytes} [Tue Feb 15 14:24:17 2022] GET /compute/v2.1/os-volumes/141266f6-601e-482d-a1a2-4b6b78a02d11 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:24:17.249389 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-8353afea-22ae-4a31-9600-2eb731a445a7 tempest-VolumesNegativeTest-746208497 tempest-VolumesNegativeTest-746208497-project] Calling method '.version_select at 0x7fd75537ba60>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:17.261885 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-505259c2-16d3-4fa3-a42c-e16b40804272 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] Calling method '.version_select at 0x7fd7543230d0>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:17.379778 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-505259c2-16d3-4fa3-a42c-e16b40804272 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/fe32d5fe-3490-4568-98b9-c55e355863a2" status: 200 len: 345 microversion: 2.1 time: 0.132825 Feb 15 14:24:17.380482 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 5/13] 10.222.0.83 () {58 vars in 1244 bytes} [Tue Feb 15 14:24:17 2022] GET /compute/v2.1/os-volumes/fe32d5fe-3490-4568-98b9-c55e355863a2 => generated 345 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:24:17.385146 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-7749a28c-798e-475f-93fe-4b62109733ff tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:17.385831 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-7749a28c-798e-475f-93fe-4b62109733ff tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:17.547885 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.wsgi [None req-8353afea-22ae-4a31-9600-2eb731a445a7 tempest-VolumesNegativeTest-746208497 tempest-VolumesNegativeTest-746208497-project] HTTP exception thrown: Volume tempest-invalid-1377384640 could not be found. Feb 15 14:24:17.548628 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-8353afea-22ae-4a31-9600-2eb731a445a7 tempest-VolumesNegativeTest-746208497 tempest-VolumesNegativeTest-746208497-project] Returning 404 to user: Volume tempest-invalid-1377384640 could not be found. {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:24:17.549609 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-8353afea-22ae-4a31-9600-2eb731a445a7 tempest-VolumesNegativeTest-746208497 tempest-VolumesNegativeTest-746208497-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1377384640" status: 404 len: 99 microversion: 2.1 time: 0.312967 Feb 15 14:24:17.555100 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 9/14] 10.222.0.83 () {58 vars in 1217 bytes} [Tue Feb 15 14:24:17 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1377384640 => generated 99 bytes in 319 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 15 14:24:17.563431 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-c42be502-cf2f-4766-9ea5-1117a7878f98 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:17.565803 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-c42be502-cf2f-4766-9ea5-1117a7878f98 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:17.620075 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-7749a28c-798e-475f-93fe-4b62109733ff tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:17.640170 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-7749a28c-798e-475f-93fe-4b62109733ff tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1215 microversion: 2.1 time: 0.258339 Feb 15 14:24:17.642482 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 6/15] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:17 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1215 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:17.648007 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-1a09688c-c50c-4a18-a9b1-a2e94e53893d tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] Action: 'create', calling method: .version_select at 0x7fd754336670>, body: {"snapshot": {"volume_id": "fe32d5fe-3490-4568-98b9-c55e355863a2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1448278997"}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:24:17.921353 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-1a09688c-c50c-4a18-a9b1-a2e94e53893d tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] 10.222.0.83 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.276798 Feb 15 14:24:17.927195 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 7/16] 10.222.0.83 () {60 vars in 1161 bytes} [Tue Feb 15 14:24:17 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:24:17.927717 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-8f52e9ce-9ba1-427c-9755-70521089117f tempest-VolumesNegativeTest-746208497 tempest-VolumesNegativeTest-746208497-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003922 Feb 15 14:24:17.928958 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 8/17] 10.222.0.83 () {58 vars in 1139 bytes} [Tue Feb 15 14:24:17 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 15 14:24:17.936214 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-3614fe99-e33e-4147-ac14-61b8c2160c49 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] Calling method '.version_select at 0x7fd7543488b0>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:17.939427 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-c42be502-cf2f-4766-9ea5-1117a7878f98 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:17.978538 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-c42be502-cf2f-4766-9ea5-1117a7878f98 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 200 len: 1218 microversion: 2.1 time: 0.421265 Feb 15 14:24:18.006781 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 10/18] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:17 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 1218 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:18.031210 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-790e3532-5dc3-4e20-b029-41aa5682939d tempest-VolumesNegativeTest-746208497 tempest-VolumesNegativeTest-746208497-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.022355 Feb 15 14:24:18.031761 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 11/19] 10.222.0.83 () {58 vars in 1136 bytes} [Tue Feb 15 14:24:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 15 14:24:18.036071 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-3614fe99-e33e-4147-ac14-61b8c2160c49 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/5f3b7814-edd1-43b9-8230-a39cd9ec03b9" status: 200 len: 287 microversion: 2.1 time: 0.105861 Feb 15 14:24:18.037053 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 9/20] 10.222.0.83 () {58 vars in 1250 bytes} [Tue Feb 15 14:24:17 2022] GET /compute/v2.1/os-snapshots/5f3b7814-edd1-43b9-8230-a39cd9ec03b9 => generated 287 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:24:18.053956 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-e33fb8b3-0755-4989-bd74-26e13dea169f tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] Calling method '.version_select at 0x7fd754348940>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:18.075635 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-3daf817c-03da-4eec-b257-8080c3f04e23 tempest-VolumesNegativeTest-746208497 tempest-VolumesNegativeTest-746208497-project] Calling method '.version_select at 0x7fd7543293a0>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:18.133955 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.wsgi [None req-3daf817c-03da-4eec-b257-8080c3f04e23 tempest-VolumesNegativeTest-746208497 tempest-VolumesNegativeTest-746208497-project] HTTP exception thrown: Volume fdd094da-08e7-4b62-8278-f4c7cddf6ec8 could not be found. Feb 15 14:24:18.134609 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-3daf817c-03da-4eec-b257-8080c3f04e23 tempest-VolumesNegativeTest-746208497 tempest-VolumesNegativeTest-746208497-project] Returning 404 to user: Volume fdd094da-08e7-4b62-8278-f4c7cddf6ec8 could not be found. {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:24:18.136329 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-3daf817c-03da-4eec-b257-8080c3f04e23 tempest-VolumesNegativeTest-746208497 tempest-VolumesNegativeTest-746208497-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/fdd094da-08e7-4b62-8278-f4c7cddf6ec8" status: 404 len: 109 microversion: 2.1 time: 0.074710 Feb 15 14:24:18.141127 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 12/21] 10.222.0.83 () {58 vars in 1247 bytes} [Tue Feb 15 14:24:18 2022] DELETE /compute/v2.1/os-volumes/fdd094da-08e7-4b62-8278-f4c7cddf6ec8 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:24:18.155989 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-41ae2455-141a-498e-8c07-8d4aa499a4e0 tempest-VolumesNegativeTest-746208497 tempest-VolumesNegativeTest-746208497-project] Calling method '.version_select at 0x7fd755484ca0>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:18.193296 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-e33fb8b3-0755-4989-bd74-26e13dea169f tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.145099 Feb 15 14:24:18.194543 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 10/22] 10.222.0.83 () {58 vars in 1139 bytes} [Tue Feb 15 14:24:18 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:24:18.217208 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-6510f0f7-eb61-4ccc-8a97-2b1af376a6d4 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] Calling method '.version_select at 0x7fd7542d43a0>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:18.254343 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.wsgi [None req-41ae2455-141a-498e-8c07-8d4aa499a4e0 tempest-VolumesNegativeTest-746208497 tempest-VolumesNegativeTest-746208497-project] HTTP exception thrown: Volume 33d837fa-99c6-4b30-894d-399766fbe6e6 could not be found. Feb 15 14:24:18.255150 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-41ae2455-141a-498e-8c07-8d4aa499a4e0 tempest-VolumesNegativeTest-746208497 tempest-VolumesNegativeTest-746208497-project] Returning 404 to user: Volume 33d837fa-99c6-4b30-894d-399766fbe6e6 could not be found. {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:24:18.255991 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-41ae2455-141a-498e-8c07-8d4aa499a4e0 tempest-VolumesNegativeTest-746208497 tempest-VolumesNegativeTest-746208497-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/33d837fa-99c6-4b30-894d-399766fbe6e6" status: 404 len: 109 microversion: 2.1 time: 0.107056 Feb 15 14:24:18.257230 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 13/23] 10.222.0.83 () {58 vars in 1244 bytes} [Tue Feb 15 14:24:18 2022] GET /compute/v2.1/os-volumes/33d837fa-99c6-4b30-894d-399766fbe6e6 => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:24:18.332668 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-6510f0f7-eb61-4ccc-8a97-2b1af376a6d4 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/5f3b7814-edd1-43b9-8230-a39cd9ec03b9" status: 200 len: 287 microversion: 2.1 time: 0.129040 Feb 15 14:24:18.333784 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 11/24] 10.222.0.83 () {58 vars in 1250 bytes} [Tue Feb 15 14:24:18 2022] GET /compute/v2.1/os-snapshots/5f3b7814-edd1-43b9-8230-a39cd9ec03b9 => generated 287 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:24:18.658518 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-a77a58f8-b468-4d7c-96bd-477da5573514 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:18.659535 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-a77a58f8-b468-4d7c-96bd-477da5573514 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:18.995222 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-6b18152c-5829-49c3-b011-8a4306a5195e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:18.995855 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-6b18152c-5829-49c3-b011-8a4306a5195e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:19.036593 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-a77a58f8-b468-4d7c-96bd-477da5573514 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:19.050816 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-a77a58f8-b468-4d7c-96bd-477da5573514 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1215 microversion: 2.1 time: 0.396376 Feb 15 14:24:19.052020 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 14/25] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:18 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1215 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:19.162225 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-6b18152c-5829-49c3-b011-8a4306a5195e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:19.183771 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-6b18152c-5829-49c3-b011-8a4306a5195e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 200 len: 1218 microversion: 2.1 time: 0.191561 Feb 15 14:24:19.185631 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 12/26] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:18 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 1218 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:19.348636 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-de3d8f1a-0162-4e7f-a59b-6f6531629eea tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] Calling method '.version_select at 0x7fd75433b430>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:19.400982 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-de3d8f1a-0162-4e7f-a59b-6f6531629eea tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/5f3b7814-edd1-43b9-8230-a39cd9ec03b9" status: 200 len: 287 microversion: 2.1 time: 0.057648 Feb 15 14:24:19.401944 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 15/27] 10.222.0.83 () {58 vars in 1250 bytes} [Tue Feb 15 14:24:19 2022] GET /compute/v2.1/os-snapshots/5f3b7814-edd1-43b9-8230-a39cd9ec03b9 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:24:20.077471 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-830ee62a-58f3-4f67-aacc-34e24c9356fc tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:20.079192 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-830ee62a-58f3-4f67-aacc-34e24c9356fc tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:20.101275 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-830ee62a-58f3-4f67-aacc-34e24c9356fc tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:20.102750 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-830ee62a-58f3-4f67-aacc-34e24c9356fc tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:20.102750 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-830ee62a-58f3-4f67-aacc-34e24c9356fc tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:20.110546 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-830ee62a-58f3-4f67-aacc-34e24c9356fc tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:20.203087 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-b6eaa319-ff1f-4c70-910b-3d6a2236fc7b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:20.203741 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-b6eaa319-ff1f-4c70-910b-3d6a2236fc7b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:20.222896 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b6eaa319-ff1f-4c70-910b-3d6a2236fc7b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:20.224684 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b6eaa319-ff1f-4c70-910b-3d6a2236fc7b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:20.225987 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b6eaa319-ff1f-4c70-910b-3d6a2236fc7b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:20.230073 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b6eaa319-ff1f-4c70-910b-3d6a2236fc7b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:20.589063 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-b6eaa319-ff1f-4c70-910b-3d6a2236fc7b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:20.613013 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-b6eaa319-ff1f-4c70-910b-3d6a2236fc7b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 200 len: 1222 microversion: 2.1 time: 0.415466 Feb 15 14:24:20.614087 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 16/28] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:20 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 1222 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:24:20.628063 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-e044eed9-4386-4130-8834-c24dcda9fb2a tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] Calling method '.version_select at 0x7fd7542a7ca0>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:20.687163 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-830ee62a-58f3-4f67-aacc-34e24c9356fc tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:20.702423 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-830ee62a-58f3-4f67-aacc-34e24c9356fc tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1219 microversion: 2.1 time: 0.636750 Feb 15 14:24:20.703013 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 13/29] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:20 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1219 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:20.717248 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-e044eed9-4386-4130-8834-c24dcda9fb2a tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/5f3b7814-edd1-43b9-8230-a39cd9ec03b9" status: 200 len: 287 microversion: 2.1 time: 0.101923 Feb 15 14:24:20.717822 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 17/30] 10.222.0.83 () {58 vars in 1250 bytes} [Tue Feb 15 14:24:20 2022] GET /compute/v2.1/os-snapshots/5f3b7814-edd1-43b9-8230-a39cd9ec03b9 => generated 287 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:24:21.633085 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-60ec7fe9-c07b-4856-910e-414eed9b6120 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:21.634356 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-60ec7fe9-c07b-4856-910e-414eed9b6120 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:21.647824 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-60ec7fe9-c07b-4856-910e-414eed9b6120 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:21.649580 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-60ec7fe9-c07b-4856-910e-414eed9b6120 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:21.652219 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-60ec7fe9-c07b-4856-910e-414eed9b6120 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:21.654637 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-60ec7fe9-c07b-4856-910e-414eed9b6120 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:21.718836 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-e996f2a1-0b1f-413d-8b67-27669c1730d0 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:21.719449 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-e996f2a1-0b1f-413d-8b67-27669c1730d0 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:21.734667 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e996f2a1-0b1f-413d-8b67-27669c1730d0 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:21.737196 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e996f2a1-0b1f-413d-8b67-27669c1730d0 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:21.738254 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e996f2a1-0b1f-413d-8b67-27669c1730d0 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:21.741897 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e996f2a1-0b1f-413d-8b67-27669c1730d0 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:22.028571 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-60ec7fe9-c07b-4856-910e-414eed9b6120 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:22.040598 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-60ec7fe9-c07b-4856-910e-414eed9b6120 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 200 len: 1222 microversion: 2.1 time: 0.413355 Feb 15 14:24:22.045551 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 14/31] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:21 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 1222 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:22.063117 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-95f92ffa-acee-425b-88c7-d4aec8687441 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] Calling method '.version_select at 0x7fd7542c7940>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:22.159128 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-95f92ffa-acee-425b-88c7-d4aec8687441 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/5f3b7814-edd1-43b9-8230-a39cd9ec03b9" status: 200 len: 288 microversion: 2.1 time: 0.108531 Feb 15 14:24:22.159667 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 15/32] 10.222.0.83 () {58 vars in 1250 bytes} [Tue Feb 15 14:24:22 2022] GET /compute/v2.1/os-snapshots/5f3b7814-edd1-43b9-8230-a39cd9ec03b9 => generated 288 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:24:22.170953 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-43d012b3-e1a2-4c77-89a1-4d10633b52db tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] Calling method '.version_select at 0x7fd7542d43a0>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:22.322039 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-43d012b3-e1a2-4c77-89a1-4d10633b52db tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] 10.222.0.83 "DELETE /compute/v2.1/os-snapshots/5f3b7814-edd1-43b9-8230-a39cd9ec03b9" status: 202 len: 0 microversion: 2.1 time: 0.154752 Feb 15 14:24:22.327244 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 16/33] 10.222.0.83 () {58 vars in 1253 bytes} [Tue Feb 15 14:24:22 2022] DELETE /compute/v2.1/os-snapshots/5f3b7814-edd1-43b9-8230-a39cd9ec03b9 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:24:22.334681 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-d6f613dc-832a-49bb-be5a-0bf7b07c8a24 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] Calling method '.version_select at 0x7fd754267d30>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:22.335998 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-e996f2a1-0b1f-413d-8b67-27669c1730d0 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:22.344154 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-e996f2a1-0b1f-413d-8b67-27669c1730d0 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1219 microversion: 2.1 time: 0.628882 Feb 15 14:24:22.347275 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 18/34] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:21 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1219 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:24:22.403017 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-d6f613dc-832a-49bb-be5a-0bf7b07c8a24 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/5f3b7814-edd1-43b9-8230-a39cd9ec03b9" status: 200 len: 287 microversion: 2.1 time: 0.074563 Feb 15 14:24:22.403603 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 17/35] 10.222.0.83 () {58 vars in 1250 bytes} [Tue Feb 15 14:24:22 2022] GET /compute/v2.1/os-snapshots/5f3b7814-edd1-43b9-8230-a39cd9ec03b9 => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:24:23.086280 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-04b77b41-6519-42b6-b76b-7aeed150427c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:23.086280 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-04b77b41-6519-42b6-b76b-7aeed150427c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:23.086280 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-04b77b41-6519-42b6-b76b-7aeed150427c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:23.087560 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-04b77b41-6519-42b6-b76b-7aeed150427c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:23.089915 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-04b77b41-6519-42b6-b76b-7aeed150427c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:23.092731 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-04b77b41-6519-42b6-b76b-7aeed150427c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:23.363967 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-97b1241a-21ea-452e-96e2-dbb57cf29142 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:23.365454 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-97b1241a-21ea-452e-96e2-dbb57cf29142 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:23.375809 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-97b1241a-21ea-452e-96e2-dbb57cf29142 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:23.377821 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-97b1241a-21ea-452e-96e2-dbb57cf29142 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:23.381524 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-97b1241a-21ea-452e-96e2-dbb57cf29142 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:23.382622 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-97b1241a-21ea-452e-96e2-dbb57cf29142 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:23.385985 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-04b77b41-6519-42b6-b76b-7aeed150427c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:23.401609 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-04b77b41-6519-42b6-b76b-7aeed150427c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 200 len: 1278 microversion: 2.1 time: 0.342807 Feb 15 14:24:23.402538 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 19/36] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:23 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 1278 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:23.416800 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-a4ec0d08-bf88-43da-906e-be1b7651ec49 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] Calling method '.version_select at 0x7fd7542a79d0>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:23.670017 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-97b1241a-21ea-452e-96e2-dbb57cf29142 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:23.678101 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-97b1241a-21ea-452e-96e2-dbb57cf29142 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1273 microversion: 2.1 time: 0.318773 Feb 15 14:24:23.680761 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 18/37] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:23 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1273 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:23.699741 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.wsgi [None req-a4ec0d08-bf88-43da-906e-be1b7651ec49 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] HTTP exception thrown: Snapshot 5f3b7814-edd1-43b9-8230-a39cd9ec03b9 could not be found. Feb 15 14:24:23.700432 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-a4ec0d08-bf88-43da-906e-be1b7651ec49 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] Returning 404 to user: Snapshot 5f3b7814-edd1-43b9-8230-a39cd9ec03b9 could not be found. {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:24:23.701422 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-a4ec0d08-bf88-43da-906e-be1b7651ec49 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/5f3b7814-edd1-43b9-8230-a39cd9ec03b9" status: 404 len: 111 microversion: 2.1 time: 0.288477 Feb 15 14:24:23.705528 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 20/38] 10.222.0.83 () {58 vars in 1250 bytes} [Tue Feb 15 14:24:23 2022] GET /compute/v2.1/os-snapshots/5f3b7814-edd1-43b9-8230-a39cd9ec03b9 => generated 111 bytes in 290 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:24:23.710349 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-1c31e8ae-307b-408d-8040-845c715ecbed tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] Calling method '.version_select at 0x7fd754258c10>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:23.912763 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-1c31e8ae-307b-408d-8040-845c715ecbed tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/fe32d5fe-3490-4568-98b9-c55e355863a2" status: 202 len: 0 microversion: 2.1 time: 0.205802 Feb 15 14:24:23.913629 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 19/39] 10.222.0.83 () {58 vars in 1247 bytes} [Tue Feb 15 14:24:23 2022] DELETE /compute/v2.1/os-volumes/fe32d5fe-3490-4568-98b9-c55e355863a2 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:24:23.927179 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-78e9e44d-463d-40d9-ac07-f8f29eaaf711 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] Calling method '.version_select at 0x7fd75433b790>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:24.137686 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-78e9e44d-463d-40d9-ac07-f8f29eaaf711 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/fe32d5fe-3490-4568-98b9-c55e355863a2" status: 200 len: 344 microversion: 2.1 time: 0.218652 Feb 15 14:24:24.139657 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 21/40] 10.222.0.83 () {58 vars in 1244 bytes} [Tue Feb 15 14:24:23 2022] GET /compute/v2.1/os-volumes/fe32d5fe-3490-4568-98b9-c55e355863a2 => generated 344 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:24:24.420977 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-6c0de7bc-74cb-4c9a-a5b3-6316f9034499 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:24.422623 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-6c0de7bc-74cb-4c9a-a5b3-6316f9034499 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:24.437905 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6c0de7bc-74cb-4c9a-a5b3-6316f9034499 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:24.438360 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6c0de7bc-74cb-4c9a-a5b3-6316f9034499 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:24.439980 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6c0de7bc-74cb-4c9a-a5b3-6316f9034499 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:24.440323 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6c0de7bc-74cb-4c9a-a5b3-6316f9034499 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:24.696283 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-5eea7d85-ec65-4660-af64-2e9cd819225f tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:24.697218 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-5eea7d85-ec65-4660-af64-2e9cd819225f tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:24.710625 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5eea7d85-ec65-4660-af64-2e9cd819225f tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:24.718233 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5eea7d85-ec65-4660-af64-2e9cd819225f tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:24.728044 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5eea7d85-ec65-4660-af64-2e9cd819225f tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:24.729406 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5eea7d85-ec65-4660-af64-2e9cd819225f tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:24.828957 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-6c0de7bc-74cb-4c9a-a5b3-6316f9034499 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:24.857896 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-6c0de7bc-74cb-4c9a-a5b3-6316f9034499 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 200 len: 1276 microversion: 2.1 time: 0.436070 Feb 15 14:24:24.878126 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 20/41] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:24 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 1276 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:25.152826 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-db7e2430-6871-4430-a6e0-4dd0a9304833 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] Calling method '.version_select at 0x7fd7542c7a60>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:25.214793 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.wsgi [None req-db7e2430-6871-4430-a6e0-4dd0a9304833 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] HTTP exception thrown: Volume fe32d5fe-3490-4568-98b9-c55e355863a2 could not be found. Feb 15 14:24:25.215394 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-db7e2430-6871-4430-a6e0-4dd0a9304833 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] Returning 404 to user: Volume fe32d5fe-3490-4568-98b9-c55e355863a2 could not be found. {{(pid=116363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:24:25.216521 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-db7e2430-6871-4430-a6e0-4dd0a9304833 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/fe32d5fe-3490-4568-98b9-c55e355863a2" status: 404 len: 109 microversion: 2.1 time: 0.067371 Feb 15 14:24:25.217366 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 21/42] 10.222.0.83 () {58 vars in 1244 bytes} [Tue Feb 15 14:24:25 2022] GET /compute/v2.1/os-volumes/fe32d5fe-3490-4568-98b9-c55e355863a2 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:24:25.258091 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-08a423df-d8da-4dd7-b52f-8b1d466c08ec tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] Calling method '.version_select at 0x7fd75422bf70>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:25.317491 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.wsgi [None req-08a423df-d8da-4dd7-b52f-8b1d466c08ec tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] HTTP exception thrown: Volume fe32d5fe-3490-4568-98b9-c55e355863a2 could not be found. Feb 15 14:24:25.318611 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-08a423df-d8da-4dd7-b52f-8b1d466c08ec tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] Returning 404 to user: Volume fe32d5fe-3490-4568-98b9-c55e355863a2 could not be found. {{(pid=116363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:24:25.320064 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-08a423df-d8da-4dd7-b52f-8b1d466c08ec tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/fe32d5fe-3490-4568-98b9-c55e355863a2" status: 404 len: 109 microversion: 2.1 time: 0.066462 Feb 15 14:24:25.320801 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 22/43] 10.222.0.83 () {58 vars in 1247 bytes} [Tue Feb 15 14:24:25 2022] DELETE /compute/v2.1/os-volumes/fe32d5fe-3490-4568-98b9-c55e355863a2 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:24:25.332042 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-80361188-a667-49ea-9a8e-8c584b191005 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] Calling method '.version_select at 0x7fd7542c7310>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:25.385594 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.wsgi [None req-80361188-a667-49ea-9a8e-8c584b191005 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] HTTP exception thrown: Volume fe32d5fe-3490-4568-98b9-c55e355863a2 could not be found. Feb 15 14:24:25.386436 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-80361188-a667-49ea-9a8e-8c584b191005 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] Returning 404 to user: Volume fe32d5fe-3490-4568-98b9-c55e355863a2 could not be found. {{(pid=116363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:24:25.387437 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-80361188-a667-49ea-9a8e-8c584b191005 tempest-VolumesSnapshotsTestJSON-2053302807 tempest-VolumesSnapshotsTestJSON-2053302807-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/fe32d5fe-3490-4568-98b9-c55e355863a2" status: 404 len: 109 microversion: 2.1 time: 0.060158 Feb 15 14:24:25.388752 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 23/44] 10.222.0.83 () {58 vars in 1244 bytes} [Tue Feb 15 14:24:25 2022] GET /compute/v2.1/os-volumes/fe32d5fe-3490-4568-98b9-c55e355863a2 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:24:25.430882 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-5eea7d85-ec65-4660-af64-2e9cd819225f tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:25.458409 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-5eea7d85-ec65-4660-af64-2e9cd819225f tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1273 microversion: 2.1 time: 0.752706 Feb 15 14:24:25.463775 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 22/45] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:24 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1273 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:24:25.893256 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-15f6c75d-aea6-419e-8a2b-bebc1ba7f03a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:25.895724 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-15f6c75d-aea6-419e-8a2b-bebc1ba7f03a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:25.911168 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-15f6c75d-aea6-419e-8a2b-bebc1ba7f03a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:25.912509 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-15f6c75d-aea6-419e-8a2b-bebc1ba7f03a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:25.915396 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-15f6c75d-aea6-419e-8a2b-bebc1ba7f03a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:25.916658 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-15f6c75d-aea6-419e-8a2b-bebc1ba7f03a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:26.113262 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-15f6c75d-aea6-419e-8a2b-bebc1ba7f03a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:26.134849 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-15f6c75d-aea6-419e-8a2b-bebc1ba7f03a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 200 len: 1276 microversion: 2.1 time: 0.254620 Feb 15 14:24:26.140750 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 24/46] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:25 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 1276 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:26.479274 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-b2c1f62c-a8bf-4747-9493-52aaa1ad5eb4 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:26.479884 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-b2c1f62c-a8bf-4747-9493-52aaa1ad5eb4 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:26.492521 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b2c1f62c-a8bf-4747-9493-52aaa1ad5eb4 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:26.492980 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b2c1f62c-a8bf-4747-9493-52aaa1ad5eb4 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:26.493776 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b2c1f62c-a8bf-4747-9493-52aaa1ad5eb4 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:26.494213 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b2c1f62c-a8bf-4747-9493-52aaa1ad5eb4 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:26.695650 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-b2c1f62c-a8bf-4747-9493-52aaa1ad5eb4 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:26.711560 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-b2c1f62c-a8bf-4747-9493-52aaa1ad5eb4 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1273 microversion: 2.1 time: 0.234895 Feb 15 14:24:26.725826 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 25/47] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:26 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1273 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:26.921571 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-92f5f88c-bbcb-4c48-aa23-f64b265b35e4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1217763829", "imageRef": "da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:24:27.073063 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.network.neutron [None req-92f5f88c-bbcb-4c48-aa23-f64b265b35e4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] validate_networks() for [('d868965e-b78e-48ae-886c-4168d86eadbf', None, None, None, None, None)] {{(pid=116362) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 14:24:27.159636 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-8bc23aa0-a7c8-48bb-88fc-0d511195d2fb tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:27.160685 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-8bc23aa0-a7c8-48bb-88fc-0d511195d2fb tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:27.181495 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8bc23aa0-a7c8-48bb-88fc-0d511195d2fb tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:27.183930 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8bc23aa0-a7c8-48bb-88fc-0d511195d2fb tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:27.187241 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8bc23aa0-a7c8-48bb-88fc-0d511195d2fb tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:27.188096 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8bc23aa0-a7c8-48bb-88fc-0d511195d2fb tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:27.551093 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-8bc23aa0-a7c8-48bb-88fc-0d511195d2fb tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:27.566438 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-8bc23aa0-a7c8-48bb-88fc-0d511195d2fb tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 200 len: 1276 microversion: 2.1 time: 0.407886 Feb 15 14:24:27.567680 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 26/48] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:27 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 1276 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:24:27.717215 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-4b274c99-427d-4924-9918-acb96186cc31 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Action: 'create', calling method: .version_select at 0x7fd75428f280>, body: {"keypair": {"name": "tempest-keypair-143722437"}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:24:27.787849 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-4b274c99-427d-4924-9918-acb96186cc31 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Getting quotas for project 061f138bf57a450295694607670540c5. Resources: {'key_pairs'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:24:27.811932 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-4b274c99-427d-4924-9918-acb96186cc31 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Getting quotas for user 85c1d5b9f2f44555ad5d2d79e7adbb28 and project 061f138bf57a450295694607670540c5. Resources: {'key_pairs'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:24:28.471147 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-4b274c99-427d-4924-9918-acb96186cc31 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Getting quotas for project 061f138bf57a450295694607670540c5. Resources: {'key_pairs'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:24:28.485210 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-4b274c99-427d-4924-9918-acb96186cc31 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Getting quotas for user 85c1d5b9f2f44555ad5d2d79e7adbb28 and project 061f138bf57a450295694607670540c5. Resources: {'key_pairs'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:24:28.543612 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-4b274c99-427d-4924-9918-acb96186cc31 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.974629 Feb 15 14:24:28.544243 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 27/49] 10.222.0.83 () {62 vars in 1198 bytes} [Tue Feb 15 14:24:27 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 976 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 15 14:24:28.556048 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-0f97070b-78db-4181-9712-1badd861c8b9 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:28.556697 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-0f97070b-78db-4181-9712-1badd861c8b9 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:28.578161 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0f97070b-78db-4181-9712-1badd861c8b9 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:28.579235 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0f97070b-78db-4181-9712-1badd861c8b9 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:28.589565 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0f97070b-78db-4181-9712-1badd861c8b9 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:28.590475 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0f97070b-78db-4181-9712-1badd861c8b9 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:28.911179 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-0f97070b-78db-4181-9712-1badd861c8b9 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:28.923702 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-0f97070b-78db-4181-9712-1badd861c8b9 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1273 microversion: 2.1 time: 0.374938 Feb 15 14:24:28.925864 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 28/50] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:28 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1273 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:28.936468 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-dca7609d-2755-4d29-9a0e-62e3399b6f35 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:28.941029 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-dca7609d-2755-4d29-9a0e-62e3399b6f35 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:28.954478 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dca7609d-2755-4d29-9a0e-62e3399b6f35 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:28.957337 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dca7609d-2755-4d29-9a0e-62e3399b6f35 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:28.959695 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dca7609d-2755-4d29-9a0e-62e3399b6f35 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:28.960365 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dca7609d-2755-4d29-9a0e-62e3399b6f35 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:29.130058 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-dca7609d-2755-4d29-9a0e-62e3399b6f35 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:29.144275 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-dca7609d-2755-4d29-9a0e-62e3399b6f35 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 200 len: 1276 microversion: 2.1 time: 0.215731 Feb 15 14:24:29.144939 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 29/51] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:28 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 1276 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:29.942623 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-4a52f2ba-ad9a-40f2-b15f-938d61bf0040 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:29.943351 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-4a52f2ba-ad9a-40f2-b15f-938d61bf0040 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:29.956302 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4a52f2ba-ad9a-40f2-b15f-938d61bf0040 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:29.956736 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4a52f2ba-ad9a-40f2-b15f-938d61bf0040 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:29.962146 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4a52f2ba-ad9a-40f2-b15f-938d61bf0040 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:29.962550 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4a52f2ba-ad9a-40f2-b15f-938d61bf0040 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:30.135848 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-92f5f88c-bbcb-4c48-aa23-f64b265b35e4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Flavor limits 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 14:24:30.136469 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-92f5f88c-bbcb-4c48-aa23-f64b265b35e4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Image limits 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 14:24:30.137085 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-92f5f88c-bbcb-4c48-aa23-f64b265b35e4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Flavor pref 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 14:24:30.138377 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-92f5f88c-bbcb-4c48-aa23-f64b265b35e4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Image pref 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 14:24:30.138807 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-92f5f88c-bbcb-4c48-aa23-f64b265b35e4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 14:24:30.154722 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-92f5f88c-bbcb-4c48-aa23-f64b265b35e4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:30.159079 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-92f5f88c-bbcb-4c48-aa23-f64b265b35e4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:30.163796 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-92f5f88c-bbcb-4c48-aa23-f64b265b35e4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:30.167603 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-92f5f88c-bbcb-4c48-aa23-f64b265b35e4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:30.239628 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-92f5f88c-bbcb-4c48-aa23-f64b265b35e4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Getting quotas for project 4079ad6434da4f068459b1ce313f662d. Resources: {'instances', 'ram', 'cores'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:24:30.259498 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-92f5f88c-bbcb-4c48-aa23-f64b265b35e4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Getting quotas for user 00597b65c3a345e29a6f6db64db1a2dd and project 4079ad6434da4f068459b1ce313f662d. Resources: {'instances', 'ram', 'cores'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:24:30.300040 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-92f5f88c-bbcb-4c48-aa23-f64b265b35e4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Going to run 1 instances... {{(pid=116362) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 14:24:30.306613 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-92f5f88c-bbcb-4c48-aa23-f64b265b35e4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 14:24:30.469084 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-92f5f88c-bbcb-4c48-aa23-f64b265b35e4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.487532 Feb 15 14:24:30.477430 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 23/52] 10.222.0.83 () {60 vars in 1146 bytes} [Tue Feb 15 14:24:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 4497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 14:24:30.504566 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-cd5bc7f6-8dec-4fd9-a1d7-50c827a1502d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:30.505200 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-cd5bc7f6-8dec-4fd9-a1d7-50c827a1502d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:30.535189 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cd5bc7f6-8dec-4fd9-a1d7-50c827a1502d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:30.544619 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cd5bc7f6-8dec-4fd9-a1d7-50c827a1502d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:30.546766 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cd5bc7f6-8dec-4fd9-a1d7-50c827a1502d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:30.552942 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cd5bc7f6-8dec-4fd9-a1d7-50c827a1502d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:31.376539 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-4a52f2ba-ad9a-40f2-b15f-938d61bf0040 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:31.392224 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-4a52f2ba-ad9a-40f2-b15f-938d61bf0040 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1315 microversion: 2.1 time: 1.454469 Feb 15 14:24:31.402673 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 30/53] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:29 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1315 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:24:31.417517 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-e1e9769c-ec22-4f93-8753-5e11b8679b91 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:31.421195 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-e1e9769c-ec22-4f93-8753-5e11b8679b91 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:31.573535 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-e1e9769c-ec22-4f93-8753-5e11b8679b91 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:31.580801 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-e1e9769c-ec22-4f93-8753-5e11b8679b91 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1222 microversion: 2.1 time: 0.176777 Feb 15 14:24:31.581397 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 31/54] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:31 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1222 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:31.875692 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-3e62c811-c679-4213-9a10-4c1daa7f406b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1062659383", "imageRef": "da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:24:32.033182 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.network.neutron [None req-3e62c811-c679-4213-9a10-4c1daa7f406b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] validate_networks() for [('d868965e-b78e-48ae-886c-4168d86eadbf', None, None, None, None, None)] {{(pid=116363) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 14:24:33.405634 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-cd5bc7f6-8dec-4fd9-a1d7-50c827a1502d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:33.428749 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-cd5bc7f6-8dec-4fd9-a1d7-50c827a1502d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 200 len: 1318 microversion: 2.1 time: 2.935244 Feb 15 14:24:33.448487 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 24/55] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:30 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 1318 bytes in 2952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:33.473774 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-3203a666-ce15-4d0a-87cf-4b788359939b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:33.477565 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-3203a666-ce15-4d0a-87cf-4b788359939b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:33.498194 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3203a666-ce15-4d0a-87cf-4b788359939b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:33.500550 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3203a666-ce15-4d0a-87cf-4b788359939b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:33.503271 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3203a666-ce15-4d0a-87cf-4b788359939b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:33.504719 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3203a666-ce15-4d0a-87cf-4b788359939b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:34.682578 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-3203a666-ce15-4d0a-87cf-4b788359939b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:34.705388 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-3203a666-ce15-4d0a-87cf-4b788359939b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1315 microversion: 2.1 time: 1.254043 Feb 15 14:24:34.708039 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 25/56] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:33 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1315 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:34.724962 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-97460cf7-6fcb-4ea3-8a70-acd72c284a3d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:34.728566 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-97460cf7-6fcb-4ea3-8a70-acd72c284a3d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:34.744677 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-97460cf7-6fcb-4ea3-8a70-acd72c284a3d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:34.745651 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-97460cf7-6fcb-4ea3-8a70-acd72c284a3d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:34.746988 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-97460cf7-6fcb-4ea3-8a70-acd72c284a3d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:34.748608 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-97460cf7-6fcb-4ea3-8a70-acd72c284a3d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:35.092244 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-3e62c811-c679-4213-9a10-4c1daa7f406b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Flavor limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 14:24:35.093252 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-3e62c811-c679-4213-9a10-4c1daa7f406b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Image limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 14:24:35.093252 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-3e62c811-c679-4213-9a10-4c1daa7f406b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Flavor pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 14:24:35.093620 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-3e62c811-c679-4213-9a10-4c1daa7f406b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Image pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 14:24:35.094043 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-3e62c811-c679-4213-9a10-4c1daa7f406b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 14:24:35.111361 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3e62c811-c679-4213-9a10-4c1daa7f406b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:35.111854 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3e62c811-c679-4213-9a10-4c1daa7f406b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:35.112636 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3e62c811-c679-4213-9a10-4c1daa7f406b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:35.113311 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3e62c811-c679-4213-9a10-4c1daa7f406b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:35.185259 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-3e62c811-c679-4213-9a10-4c1daa7f406b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Getting quotas for project 4079ad6434da4f068459b1ce313f662d. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:24:35.225144 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-3e62c811-c679-4213-9a10-4c1daa7f406b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Getting quotas for user 00597b65c3a345e29a6f6db64db1a2dd and project 4079ad6434da4f068459b1ce313f662d. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:24:35.251592 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-3e62c811-c679-4213-9a10-4c1daa7f406b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Going to run 1 instances... {{(pid=116363) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 14:24:35.254277 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-3e62c811-c679-4213-9a10-4c1daa7f406b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 14:24:35.341908 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-3e62c811-c679-4213-9a10-4c1daa7f406b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.470502 Feb 15 14:24:35.343163 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 32/57] 10.222.0.83 () {60 vars in 1146 bytes} [Tue Feb 15 14:24:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 3473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 15 14:24:35.364949 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-86d28bbe-f264-4164-a87f-ec3744b2231d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:35.365327 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-86d28bbe-f264-4164-a87f-ec3744b2231d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:35.696159 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-86d28bbe-f264-4164-a87f-ec3744b2231d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:35.716589 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-86d28bbe-f264-4164-a87f-ec3744b2231d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1222 microversion: 2.1 time: 0.366307 Feb 15 14:24:35.736934 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 33/58] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:35 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1222 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:35.743499 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-77cb48d7-1191-4962-bc70-349560115947 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:35.750959 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-77cb48d7-1191-4962-bc70-349560115947 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:35.779093 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-77cb48d7-1191-4962-bc70-349560115947 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:35.783150 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-77cb48d7-1191-4962-bc70-349560115947 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:35.784886 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-77cb48d7-1191-4962-bc70-349560115947 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:35.786727 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-77cb48d7-1191-4962-bc70-349560115947 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:37.055825 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-77cb48d7-1191-4962-bc70-349560115947 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:37.073687 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-77cb48d7-1191-4962-bc70-349560115947 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1315 microversion: 2.1 time: 1.334566 Feb 15 14:24:37.075422 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 34/59] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:35 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1315 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:37.085462 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-97460cf7-6fcb-4ea3-8a70-acd72c284a3d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:37.093105 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-97460cf7-6fcb-4ea3-8a70-acd72c284a3d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 200 len: 1318 microversion: 2.1 time: 2.376760 Feb 15 14:24:37.096524 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 26/60] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:34 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 1318 bytes in 2387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:37.110870 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-7f0c72d7-31b7-48a3-9e04-2562daf02cdc tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:37.112885 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-7f0c72d7-31b7-48a3-9e04-2562daf02cdc tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:37.124133 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7f0c72d7-31b7-48a3-9e04-2562daf02cdc tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:37.124940 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7f0c72d7-31b7-48a3-9e04-2562daf02cdc tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:37.127093 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7f0c72d7-31b7-48a3-9e04-2562daf02cdc tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:37.127744 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7f0c72d7-31b7-48a3-9e04-2562daf02cdc tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:37.436256 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-7f0c72d7-31b7-48a3-9e04-2562daf02cdc tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:37.448265 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-7f0c72d7-31b7-48a3-9e04-2562daf02cdc tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1218 microversion: 2.1 time: 0.356071 Feb 15 14:24:37.449453 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 35/61] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:37 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1218 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:38.093328 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-63dfb76d-8379-46dc-9fed-0c5ad05f9924 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:38.094164 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-63dfb76d-8379-46dc-9fed-0c5ad05f9924 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:38.103935 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-63dfb76d-8379-46dc-9fed-0c5ad05f9924 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:38.113049 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-031af601-8f55-444e-87ae-2125a31f7e6c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:38.113804 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-031af601-8f55-444e-87ae-2125a31f7e6c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:38.122185 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-63dfb76d-8379-46dc-9fed-0c5ad05f9924 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:38.129868 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-63dfb76d-8379-46dc-9fed-0c5ad05f9924 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:38.130404 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-031af601-8f55-444e-87ae-2125a31f7e6c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:38.132518 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-031af601-8f55-444e-87ae-2125a31f7e6c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:38.132843 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-63dfb76d-8379-46dc-9fed-0c5ad05f9924 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:38.134138 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-031af601-8f55-444e-87ae-2125a31f7e6c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:38.136292 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-031af601-8f55-444e-87ae-2125a31f7e6c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:38.743310 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-031af601-8f55-444e-87ae-2125a31f7e6c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:38.753693 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-031af601-8f55-444e-87ae-2125a31f7e6c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 200 len: 1318 microversion: 2.1 time: 0.646057 Feb 15 14:24:38.754521 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 36/62] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:38 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 1318 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:24:38.771988 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-298f7e9b-9b98-4a08-b90e-30e1487b973e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1275075532", "imageRef": "da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0957828b-89e7-4901-abcf-9cdcc101c9e7"}], "security_groups": [{"name": "tempest-securitygroup--1471218033"}], "key_name": "tempest-keypair-143722437", "user_data": "}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:24:39.081002 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-63dfb76d-8379-46dc-9fed-0c5ad05f9924 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:39.095480 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-63dfb76d-8379-46dc-9fed-0c5ad05f9924 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1315 microversion: 2.1 time: 1.005057 Feb 15 14:24:39.097310 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 27/63] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:38 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1315 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:39.322500 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.network.neutron [None req-298f7e9b-9b98-4a08-b90e-30e1487b973e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] validate_networks() for [('0957828b-89e7-4901-abcf-9cdcc101c9e7', None, None, None, None, None)] {{(pid=116363) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 14:24:39.370626 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-dd66f300-b635-4c6f-9ffb-704abca739ef req-c6c05b3c-9377-4187-8f4a-5d1efcc44206 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d6c38be-13a5-4c57-badb-c4371acfb34c", "tag": "7733954e-5190-40f9-8b4f-c132526b121a"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:24:39.375706 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:24:39.375706 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:24:39.397981 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-dd66f300-b635-4c6f-9ffb-704abca739ef req-c6c05b3c-9377-4187-8f4a-5d1efcc44206 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:39.398329 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-dd66f300-b635-4c6f-9ffb-704abca739ef req-c6c05b3c-9377-4187-8f4a-5d1efcc44206 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:39.447080 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-dd66f300-b635-4c6f-9ffb-704abca739ef req-c6c05b3c-9377-4187-8f4a-5d1efcc44206 service nova] Creating event network-changed:7733954e-5190-40f9-8b4f-c132526b121a for instance 2d6c38be-13a5-4c57-badb-c4371acfb34c on hv-cinder-81914 Feb 15 14:24:39.447617 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-dd66f300-b635-4c6f-9ffb-704abca739ef req-c6c05b3c-9377-4187-8f4a-5d1efcc44206 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116362) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 15 14:24:39.448750 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e00a0ac7-b396-460b-8f0a-4808598e03b4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:39.449372 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e00a0ac7-b396-460b-8f0a-4808598e03b4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:39.450416 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e00a0ac7-b396-460b-8f0a-4808598e03b4 None None] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:39.451016 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e00a0ac7-b396-460b-8f0a-4808598e03b4 None None] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:39.462052 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.compute.rpcapi [None req-e00a0ac7-b396-460b-8f0a-4808598e03b4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 15 14:24:39.463201 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e00a0ac7-b396-460b-8f0a-4808598e03b4 None None] Releasing lock "compute-rpcapi-router" {{(pid=116362) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 15 14:24:39.490434 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-e00a0ac7-b396-460b-8f0a-4808598e03b4 None None] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.391858 Feb 15 14:24:39.491262 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 28/64] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:24:39.498658 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-72f1a1c1-9fe0-4de3-ba9f-ee6b32ebcd57 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:39.500033 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-72f1a1c1-9fe0-4de3-ba9f-ee6b32ebcd57 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:39.512481 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-72f1a1c1-9fe0-4de3-ba9f-ee6b32ebcd57 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:39.513977 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-72f1a1c1-9fe0-4de3-ba9f-ee6b32ebcd57 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:39.515143 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-72f1a1c1-9fe0-4de3-ba9f-ee6b32ebcd57 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:39.515790 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-72f1a1c1-9fe0-4de3-ba9f-ee6b32ebcd57 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:39.671454 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-72f1a1c1-9fe0-4de3-ba9f-ee6b32ebcd57 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:39.683247 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-72f1a1c1-9fe0-4de3-ba9f-ee6b32ebcd57 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1280 microversion: 2.1 time: 0.190235 Feb 15 14:24:39.684197 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 29/65] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:39 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1280 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:39.776552 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-8083bec6-fa90-47d6-acc4-ae2e18721b11 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:39.781139 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-8083bec6-fa90-47d6-acc4-ae2e18721b11 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:39.817572 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8083bec6-fa90-47d6-acc4-ae2e18721b11 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:39.818091 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8083bec6-fa90-47d6-acc4-ae2e18721b11 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:39.818943 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8083bec6-fa90-47d6-acc4-ae2e18721b11 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:39.822643 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8083bec6-fa90-47d6-acc4-ae2e18721b11 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:40.180869 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-8083bec6-fa90-47d6-acc4-ae2e18721b11 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:40.190049 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-8083bec6-fa90-47d6-acc4-ae2e18721b11 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 200 len: 1318 microversion: 2.1 time: 0.421617 Feb 15 14:24:40.190852 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 30/66] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:39 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:40.195456 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-294a6405-5d2b-45d5-9290-b247c4b8596b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:40.196291 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-294a6405-5d2b-45d5-9290-b247c4b8596b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:40.202582 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-294a6405-5d2b-45d5-9290-b247c4b8596b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:40.203319 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-294a6405-5d2b-45d5-9290-b247c4b8596b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:40.204901 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-294a6405-5d2b-45d5-9290-b247c4b8596b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:40.205547 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-294a6405-5d2b-45d5-9290-b247c4b8596b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:40.439607 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-294a6405-5d2b-45d5-9290-b247c4b8596b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:40.448123 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-294a6405-5d2b-45d5-9290-b247c4b8596b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1315 microversion: 2.1 time: 0.255898 Feb 15 14:24:40.449236 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 31/67] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:40 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:40.706332 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-d21a6c1e-10a7-4476-a61c-2a23ba757b53 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:40.706948 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-d21a6c1e-10a7-4476-a61c-2a23ba757b53 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:40.712959 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d21a6c1e-10a7-4476-a61c-2a23ba757b53 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:40.713631 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d21a6c1e-10a7-4476-a61c-2a23ba757b53 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:40.714603 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d21a6c1e-10a7-4476-a61c-2a23ba757b53 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:40.715204 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d21a6c1e-10a7-4476-a61c-2a23ba757b53 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:40.818360 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-d21a6c1e-10a7-4476-a61c-2a23ba757b53 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:40.827643 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-d21a6c1e-10a7-4476-a61c-2a23ba757b53 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1280 microversion: 2.1 time: 0.125477 Feb 15 14:24:40.828455 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 32/68] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:40 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1280 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:41.211060 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-807e7a94-4205-4b1f-9b0c-f52fac1c722e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:41.211646 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-807e7a94-4205-4b1f-9b0c-f52fac1c722e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:41.216909 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-298f7e9b-9b98-4a08-b90e-30e1487b973e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Flavor limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 14:24:41.220567 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-298f7e9b-9b98-4a08-b90e-30e1487b973e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Image limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 14:24:41.221566 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-807e7a94-4205-4b1f-9b0c-f52fac1c722e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:41.222604 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-298f7e9b-9b98-4a08-b90e-30e1487b973e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Flavor pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 14:24:41.223165 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-807e7a94-4205-4b1f-9b0c-f52fac1c722e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:41.223883 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-298f7e9b-9b98-4a08-b90e-30e1487b973e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Image pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 14:24:41.224000 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-807e7a94-4205-4b1f-9b0c-f52fac1c722e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:41.224424 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-807e7a94-4205-4b1f-9b0c-f52fac1c722e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:41.225041 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-298f7e9b-9b98-4a08-b90e-30e1487b973e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 14:24:41.241754 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-298f7e9b-9b98-4a08-b90e-30e1487b973e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:41.243290 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-298f7e9b-9b98-4a08-b90e-30e1487b973e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:41.245234 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-298f7e9b-9b98-4a08-b90e-30e1487b973e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:41.246440 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-298f7e9b-9b98-4a08-b90e-30e1487b973e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:41.284390 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-298f7e9b-9b98-4a08-b90e-30e1487b973e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Getting quotas for project 061f138bf57a450295694607670540c5. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:24:41.291420 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-298f7e9b-9b98-4a08-b90e-30e1487b973e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Getting quotas for user 85c1d5b9f2f44555ad5d2d79e7adbb28 and project 061f138bf57a450295694607670540c5. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:24:41.306532 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-298f7e9b-9b98-4a08-b90e-30e1487b973e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Going to run 1 instances... {{(pid=116363) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 14:24:41.310125 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-298f7e9b-9b98-4a08-b90e-30e1487b973e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 14:24:41.377164 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-298f7e9b-9b98-4a08-b90e-30e1487b973e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.621352 Feb 15 14:24:41.379715 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 37/69] 10.222.0.83 () {62 vars in 1187 bytes} [Tue Feb 15 14:24:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 2624 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 15 14:24:41.401432 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-616a1f24-8c4f-4632-8285-70114bab33c9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:41.402540 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-616a1f24-8c4f-4632-8285-70114bab33c9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:41.670355 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-807e7a94-4205-4b1f-9b0c-f52fac1c722e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:41.679842 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-807e7a94-4205-4b1f-9b0c-f52fac1c722e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 200 len: 1318 microversion: 2.1 time: 0.476552 Feb 15 14:24:41.691385 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 33/70] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:41 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 1318 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:24:41.696083 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-7c32521a-3ec8-4ff5-93d3-1f8fb96c7295 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:41.697254 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-7c32521a-3ec8-4ff5-93d3-1f8fb96c7295 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:41.708302 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7c32521a-3ec8-4ff5-93d3-1f8fb96c7295 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:41.708942 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7c32521a-3ec8-4ff5-93d3-1f8fb96c7295 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:41.709867 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7c32521a-3ec8-4ff5-93d3-1f8fb96c7295 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:41.710430 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7c32521a-3ec8-4ff5-93d3-1f8fb96c7295 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:41.754819 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-616a1f24-8c4f-4632-8285-70114bab33c9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:41.763375 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-616a1f24-8c4f-4632-8285-70114bab33c9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:41.773320 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-616a1f24-8c4f-4632-8285-70114bab33c9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:41.774496 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-616a1f24-8c4f-4632-8285-70114bab33c9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1281 microversion: 2.20 time: 0.380583 Feb 15 14:24:41.775084 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 38/71] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:24:41 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1281 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:24:41.791056 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-83cd17b2-f342-4861-a0e7-110fe4366483 req-f3e44f60-fd1b-4dd7-a81d-ff1852408a6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5c5ab4c-5386-4e98-a890-434b75b6fa0f", "tag": "9cc8b6d0-5c94-45c4-86e5-52e57da30c8f"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:24:41.807022 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:24:41.807022 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:24:41.817968 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-83cd17b2-f342-4861-a0e7-110fe4366483 req-f3e44f60-fd1b-4dd7-a81d-ff1852408a6b service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:41.818411 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-83cd17b2-f342-4861-a0e7-110fe4366483 req-f3e44f60-fd1b-4dd7-a81d-ff1852408a6b service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:41.852751 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-83cd17b2-f342-4861-a0e7-110fe4366483 req-f3e44f60-fd1b-4dd7-a81d-ff1852408a6b service nova] Creating event network-changed:9cc8b6d0-5c94-45c4-86e5-52e57da30c8f for instance f5c5ab4c-5386-4e98-a890-434b75b6fa0f on hv-cinder-81914 Feb 15 14:24:41.853301 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-83cd17b2-f342-4861-a0e7-110fe4366483 req-f3e44f60-fd1b-4dd7-a81d-ff1852408a6b service nova] Acquired lock "compute-rpcapi-router" {{(pid=116363) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 15 14:24:41.854938 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5fbad78c-9725-468e-884f-e6eb3e878905 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:41.855378 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5fbad78c-9725-468e-884f-e6eb3e878905 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:41.856285 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5fbad78c-9725-468e-884f-e6eb3e878905 None None] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:41.857738 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5fbad78c-9725-468e-884f-e6eb3e878905 None None] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:41.873166 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.compute.rpcapi [None req-5fbad78c-9725-468e-884f-e6eb3e878905 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 15 14:24:41.877864 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5fbad78c-9725-468e-884f-e6eb3e878905 None None] Releasing lock "compute-rpcapi-router" {{(pid=116363) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 15 14:24:41.911337 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-5fbad78c-9725-468e-884f-e6eb3e878905 None None] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133276 Feb 15 14:24:41.911974 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 39/72] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:24:41.918833 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-2fa9570f-61cd-4b47-9bc8-5eb01758bee4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:41.919525 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-2fa9570f-61cd-4b47-9bc8-5eb01758bee4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:41.940989 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2fa9570f-61cd-4b47-9bc8-5eb01758bee4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:41.941679 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2fa9570f-61cd-4b47-9bc8-5eb01758bee4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:41.942782 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2fa9570f-61cd-4b47-9bc8-5eb01758bee4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:41.943979 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2fa9570f-61cd-4b47-9bc8-5eb01758bee4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:41.952723 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-7c32521a-3ec8-4ff5-93d3-1f8fb96c7295 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:41.965965 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-7c32521a-3ec8-4ff5-93d3-1f8fb96c7295 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1315 microversion: 2.1 time: 0.270470 Feb 15 14:24:41.969210 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 34/73] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:41 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:42.704950 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-6b87f832-77d8-4199-b3a8-dd021a7524ce req-433ccb47-3a0d-436e-8d37-a7c45d95c428 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13edf4fd-20da-43ce-bb58-5757dc0f96c7", "tag": "09e7ae20-efee-4ba4-bc83-98bd05f41729"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:24:42.707328 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:24:42.707328 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:24:42.721106 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-6b87f832-77d8-4199-b3a8-dd021a7524ce req-433ccb47-3a0d-436e-8d37-a7c45d95c428 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:42.721879 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-6b87f832-77d8-4199-b3a8-dd021a7524ce req-433ccb47-3a0d-436e-8d37-a7c45d95c428 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:42.755702 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-6b87f832-77d8-4199-b3a8-dd021a7524ce req-433ccb47-3a0d-436e-8d37-a7c45d95c428 service nova] Creating event network-changed:09e7ae20-efee-4ba4-bc83-98bd05f41729 for instance 13edf4fd-20da-43ce-bb58-5757dc0f96c7 on hv-cinder-81914 Feb 15 14:24:42.770136 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-6b87f832-77d8-4199-b3a8-dd021a7524ce req-433ccb47-3a0d-436e-8d37-a7c45d95c428 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.340364 Feb 15 14:24:42.771970 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 35/74] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:24:42.780506 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-aa6302c6-3962-428c-9a88-a33df96c1004 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:42.781564 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-aa6302c6-3962-428c-9a88-a33df96c1004 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:42.795974 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-aa6302c6-3962-428c-9a88-a33df96c1004 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:42.796707 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-aa6302c6-3962-428c-9a88-a33df96c1004 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:42.798360 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-aa6302c6-3962-428c-9a88-a33df96c1004 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:42.798970 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-aa6302c6-3962-428c-9a88-a33df96c1004 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:42.906617 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-2fa9570f-61cd-4b47-9bc8-5eb01758bee4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:42.918228 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-2fa9570f-61cd-4b47-9bc8-5eb01758bee4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1322 microversion: 2.1 time: 1.004849 Feb 15 14:24:42.930100 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 40/75] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:41 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1322 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:42.950073 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-dfd7e52c-2572-4103-975c-a6b000cec38b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:42.951185 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-dfd7e52c-2572-4103-975c-a6b000cec38b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:42.969072 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dfd7e52c-2572-4103-975c-a6b000cec38b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:42.971435 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dfd7e52c-2572-4103-975c-a6b000cec38b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:42.973587 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dfd7e52c-2572-4103-975c-a6b000cec38b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:42.975356 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dfd7e52c-2572-4103-975c-a6b000cec38b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:43.093700 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-aa6302c6-3962-428c-9a88-a33df96c1004 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:43.111502 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-aa6302c6-3962-428c-9a88-a33df96c1004 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 200 len: 1318 microversion: 2.1 time: 0.337878 Feb 15 14:24:43.112579 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 36/76] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:42 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:43.126822 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-efdd8ab6-87e3-49e1-978b-a7429ed44dcf tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:43.127335 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-efdd8ab6-87e3-49e1-978b-a7429ed44dcf tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:43.144484 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-efdd8ab6-87e3-49e1-978b-a7429ed44dcf tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:43.145178 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-efdd8ab6-87e3-49e1-978b-a7429ed44dcf tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:43.148440 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-efdd8ab6-87e3-49e1-978b-a7429ed44dcf tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:43.150099 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-efdd8ab6-87e3-49e1-978b-a7429ed44dcf tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:43.168351 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-dfd7e52c-2572-4103-975c-a6b000cec38b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:43.186156 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-dfd7e52c-2572-4103-975c-a6b000cec38b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:43.189386 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-dfd7e52c-2572-4103-975c-a6b000cec38b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:43.192513 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-dfd7e52c-2572-4103-975c-a6b000cec38b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1333 microversion: 2.20 time: 0.260985 Feb 15 14:24:43.212960 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 41/77] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:24:42 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1333 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:24:43.511495 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-efdd8ab6-87e3-49e1-978b-a7429ed44dcf tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:43.520311 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-efdd8ab6-87e3-49e1-978b-a7429ed44dcf tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1315 microversion: 2.1 time: 0.405804 Feb 15 14:24:43.521492 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 37/78] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:43 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:43.940066 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-dc32e804-b7b3-49b5-b4cc-913f73a6597f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:43.940634 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-dc32e804-b7b3-49b5-b4cc-913f73a6597f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:43.947501 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dc32e804-b7b3-49b5-b4cc-913f73a6597f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:43.949035 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dc32e804-b7b3-49b5-b4cc-913f73a6597f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:43.950505 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dc32e804-b7b3-49b5-b4cc-913f73a6597f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:43.951095 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dc32e804-b7b3-49b5-b4cc-913f73a6597f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:44.134011 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-ea01bfc9-ed1f-4eea-9106-0c555c9549a7 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:44.134011 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-ea01bfc9-ed1f-4eea-9106-0c555c9549a7 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:44.148027 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ea01bfc9-ed1f-4eea-9106-0c555c9549a7 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:44.148935 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ea01bfc9-ed1f-4eea-9106-0c555c9549a7 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:44.152626 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ea01bfc9-ed1f-4eea-9106-0c555c9549a7 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:44.153321 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ea01bfc9-ed1f-4eea-9106-0c555c9549a7 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:44.460440 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-ea01bfc9-ed1f-4eea-9106-0c555c9549a7 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:44.477397 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-ea01bfc9-ed1f-4eea-9106-0c555c9549a7 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 200 len: 1318 microversion: 2.1 time: 0.351660 Feb 15 14:24:44.486715 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 38/79] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:44 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:44.495054 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-e53af4c1-1105-4e42-aa2a-93dda7a6576a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:44.495665 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-e53af4c1-1105-4e42-aa2a-93dda7a6576a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:44.511116 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e53af4c1-1105-4e42-aa2a-93dda7a6576a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:44.511568 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e53af4c1-1105-4e42-aa2a-93dda7a6576a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:44.514828 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e53af4c1-1105-4e42-aa2a-93dda7a6576a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:44.516102 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e53af4c1-1105-4e42-aa2a-93dda7a6576a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:44.817093 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-dc32e804-b7b3-49b5-b4cc-913f73a6597f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:44.826508 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-dc32e804-b7b3-49b5-b4cc-913f73a6597f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1322 microversion: 2.1 time: 0.891557 Feb 15 14:24:44.827421 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 42/80] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:43 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1322 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:44.840939 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-c470a7e5-ab9d-4a66-830a-841cf2d3384b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:44.841541 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-c470a7e5-ab9d-4a66-830a-841cf2d3384b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:44.851904 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c470a7e5-ab9d-4a66-830a-841cf2d3384b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:44.861363 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c470a7e5-ab9d-4a66-830a-841cf2d3384b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:44.862449 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c470a7e5-ab9d-4a66-830a-841cf2d3384b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:44.863042 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c470a7e5-ab9d-4a66-830a-841cf2d3384b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:45.041786 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-e53af4c1-1105-4e42-aa2a-93dda7a6576a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:45.056157 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-e53af4c1-1105-4e42-aa2a-93dda7a6576a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:45.058119 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-e53af4c1-1105-4e42-aa2a-93dda7a6576a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:45.063733 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-e53af4c1-1105-4e42-aa2a-93dda7a6576a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1407 microversion: 2.20 time: 0.574621 Feb 15 14:24:45.066478 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 39/81] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:24:44 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1407 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:24:45.084812 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-f55d363e-6cf9-4173-a910-4e7652c9cc23 req-ea075629-6e44-459e-83dc-a2d1e224c265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da335cfa-e017-4c76-b734-1aa9f65add13", "tag": "9aa04bc6-dbe4-47a7-b359-c0906fd2d893"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:24:45.095380 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:24:45.095380 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:24:45.112650 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-f55d363e-6cf9-4173-a910-4e7652c9cc23 req-ea075629-6e44-459e-83dc-a2d1e224c265 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:45.113038 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-f55d363e-6cf9-4173-a910-4e7652c9cc23 req-ea075629-6e44-459e-83dc-a2d1e224c265 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:45.141877 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-f55d363e-6cf9-4173-a910-4e7652c9cc23 req-ea075629-6e44-459e-83dc-a2d1e224c265 service nova] Creating event network-changed:9aa04bc6-dbe4-47a7-b359-c0906fd2d893 for instance da335cfa-e017-4c76-b734-1aa9f65add13 on hv-cinder-81914 Feb 15 14:24:45.150712 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-f55d363e-6cf9-4173-a910-4e7652c9cc23 req-ea075629-6e44-459e-83dc-a2d1e224c265 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082750 Feb 15 14:24:45.152065 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 40/82] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:24:45.451787 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-c470a7e5-ab9d-4a66-830a-841cf2d3384b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:45.462203 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-c470a7e5-ab9d-4a66-830a-841cf2d3384b tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1315 microversion: 2.1 time: 0.633716 Feb 15 14:24:45.462796 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 43/83] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:44 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1315 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:45.500102 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-936b5bf4-9f70-48f6-b2e9-88fd49511998 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:45.502742 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-936b5bf4-9f70-48f6-b2e9-88fd49511998 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:45.525903 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-936b5bf4-9f70-48f6-b2e9-88fd49511998 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:45.534305 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-936b5bf4-9f70-48f6-b2e9-88fd49511998 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:45.538343 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-936b5bf4-9f70-48f6-b2e9-88fd49511998 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:45.539223 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-936b5bf4-9f70-48f6-b2e9-88fd49511998 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:45.848205 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-c9617a43-34c5-4c50-86fd-b8545054ba97 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:45.849336 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-c9617a43-34c5-4c50-86fd-b8545054ba97 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:45.856882 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c9617a43-34c5-4c50-86fd-b8545054ba97 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:45.857971 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c9617a43-34c5-4c50-86fd-b8545054ba97 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:45.859171 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c9617a43-34c5-4c50-86fd-b8545054ba97 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:45.859864 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c9617a43-34c5-4c50-86fd-b8545054ba97 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:46.174317 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-c9617a43-34c5-4c50-86fd-b8545054ba97 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:46.185931 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-c9617a43-34c5-4c50-86fd-b8545054ba97 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1322 microversion: 2.1 time: 0.343970 Feb 15 14:24:46.188900 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 44/84] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:45 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1322 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:46.207110 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-4646cbda-ec5c-4c69-8071-a76775965436 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:46.208761 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-4646cbda-ec5c-4c69-8071-a76775965436 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:46.225480 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4646cbda-ec5c-4c69-8071-a76775965436 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:46.226135 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4646cbda-ec5c-4c69-8071-a76775965436 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:46.227900 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4646cbda-ec5c-4c69-8071-a76775965436 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:46.230143 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4646cbda-ec5c-4c69-8071-a76775965436 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:46.696340 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-4646cbda-ec5c-4c69-8071-a76775965436 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:46.709942 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-4646cbda-ec5c-4c69-8071-a76775965436 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:46.711928 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-4646cbda-ec5c-4c69-8071-a76775965436 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:46.717399 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-4646cbda-ec5c-4c69-8071-a76775965436 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1407 microversion: 2.20 time: 0.527080 Feb 15 14:24:46.721169 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 45/85] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:24:46 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1407 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:24:46.728820 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-86d740ab-d530-4dc7-888b-cabd8efebf39 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:46.731607 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-86d740ab-d530-4dc7-888b-cabd8efebf39 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:46.751574 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-86d740ab-d530-4dc7-888b-cabd8efebf39 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:46.755459 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-86d740ab-d530-4dc7-888b-cabd8efebf39 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:46.757625 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-86d740ab-d530-4dc7-888b-cabd8efebf39 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:46.758261 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-86d740ab-d530-4dc7-888b-cabd8efebf39 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:47.051223 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-936b5bf4-9f70-48f6-b2e9-88fd49511998 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:47.065461 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-936b5bf4-9f70-48f6-b2e9-88fd49511998 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 200 len: 1318 microversion: 2.1 time: 1.571031 Feb 15 14:24:47.076120 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 41/86] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:45 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 1318 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:47.109031 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-86d740ab-d530-4dc7-888b-cabd8efebf39 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:47.122132 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-86d740ab-d530-4dc7-888b-cabd8efebf39 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1315 microversion: 2.1 time: 0.398123 Feb 15 14:24:47.123237 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 46/87] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:46 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:47.203565 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-c2cc8836-46ca-441c-b139-aaaa34ed0b46 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:47.204471 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-c2cc8836-46ca-441c-b139-aaaa34ed0b46 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:47.217853 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c2cc8836-46ca-441c-b139-aaaa34ed0b46 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:47.218337 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c2cc8836-46ca-441c-b139-aaaa34ed0b46 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:47.222011 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c2cc8836-46ca-441c-b139-aaaa34ed0b46 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:47.226219 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c2cc8836-46ca-441c-b139-aaaa34ed0b46 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:47.305176 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-883b2129-0e27-4acc-ae0e-eb3a187135cd req-1f535104-4670-4222-a541-ce7f8e5b87b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c04d927-9f34-4f11-8502-7175a64e3923", "tag": "23ef841c-69a3-483c-9bb9-680e3d5b6392"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:24:47.318267 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:24:47.318267 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:24:47.337014 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-883b2129-0e27-4acc-ae0e-eb3a187135cd req-1f535104-4670-4222-a541-ce7f8e5b87b1 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:47.337459 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-883b2129-0e27-4acc-ae0e-eb3a187135cd req-1f535104-4670-4222-a541-ce7f8e5b87b1 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:47.356040 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-883b2129-0e27-4acc-ae0e-eb3a187135cd req-1f535104-4670-4222-a541-ce7f8e5b87b1 service nova] Creating event network-changed:23ef841c-69a3-483c-9bb9-680e3d5b6392 for instance 9c04d927-9f34-4f11-8502-7175a64e3923 on hv-cinder-81914 Feb 15 14:24:47.363273 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-883b2129-0e27-4acc-ae0e-eb3a187135cd req-1f535104-4670-4222-a541-ce7f8e5b87b1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062681 Feb 15 14:24:47.364302 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 47/88] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:24:47.634657 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-c2cc8836-46ca-441c-b139-aaaa34ed0b46 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:47.643864 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-c2cc8836-46ca-441c-b139-aaaa34ed0b46 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1322 microversion: 2.1 time: 0.444316 Feb 15 14:24:47.644915 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 42/89] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:47 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1322 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:47.740262 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-d8c2586d-237c-46c2-837a-71955559aac5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:47.741117 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-d8c2586d-237c-46c2-837a-71955559aac5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:47.748137 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d8c2586d-237c-46c2-837a-71955559aac5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:47.749270 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d8c2586d-237c-46c2-837a-71955559aac5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:47.751066 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d8c2586d-237c-46c2-837a-71955559aac5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:47.751712 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d8c2586d-237c-46c2-837a-71955559aac5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:48.069636 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-d8c2586d-237c-46c2-837a-71955559aac5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:48.083568 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-152ec87c-dd23-430b-802a-8a6dd35a08c6 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:48.084164 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-152ec87c-dd23-430b-802a-8a6dd35a08c6 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:48.088720 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-d8c2586d-237c-46c2-837a-71955559aac5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:48.092014 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-d8c2586d-237c-46c2-837a-71955559aac5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:48.094707 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-d8c2586d-237c-46c2-837a-71955559aac5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1407 microversion: 2.20 time: 0.359269 Feb 15 14:24:48.097298 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 48/90] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:24:47 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1407 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:24:48.098193 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-152ec87c-dd23-430b-802a-8a6dd35a08c6 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:48.099121 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-152ec87c-dd23-430b-802a-8a6dd35a08c6 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:48.101551 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-152ec87c-dd23-430b-802a-8a6dd35a08c6 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:48.103973 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-152ec87c-dd23-430b-802a-8a6dd35a08c6 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:48.143182 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-7adb83b0-3561-4322-9315-64bfb9bbede9 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:48.143895 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-7adb83b0-3561-4322-9315-64bfb9bbede9 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:48.159489 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7adb83b0-3561-4322-9315-64bfb9bbede9 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:48.160939 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7adb83b0-3561-4322-9315-64bfb9bbede9 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:48.162943 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7adb83b0-3561-4322-9315-64bfb9bbede9 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:48.164765 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7adb83b0-3561-4322-9315-64bfb9bbede9 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:48.442318 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-7adb83b0-3561-4322-9315-64bfb9bbede9 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:48.451189 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-7adb83b0-3561-4322-9315-64bfb9bbede9 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1315 microversion: 2.1 time: 0.316143 Feb 15 14:24:48.457949 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 49/91] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:48 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:48.481765 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-152ec87c-dd23-430b-802a-8a6dd35a08c6 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:48.493126 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-152ec87c-dd23-430b-802a-8a6dd35a08c6 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 200 len: 1318 microversion: 2.1 time: 0.411003 Feb 15 14:24:48.495426 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 43/92] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:48 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:48.661379 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-301b4786-b213-45be-9d33-156868c872f8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:48.662390 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-301b4786-b213-45be-9d33-156868c872f8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:48.672354 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-301b4786-b213-45be-9d33-156868c872f8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:48.675554 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-301b4786-b213-45be-9d33-156868c872f8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:48.676620 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-301b4786-b213-45be-9d33-156868c872f8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:48.679492 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-301b4786-b213-45be-9d33-156868c872f8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:48.833671 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-e5df5757-e132-4124-99e8-032a662e7788 req-ac2e60f0-2404-487f-a8e3-8a69ac2a4033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d6c38be-13a5-4c57-badb-c4371acfb34c", "name": "network-vif-plugged", "status": "completed", "tag": "7733954e-5190-40f9-8b4f-c132526b121a"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:24:48.835293 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:24:48.835293 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:24:48.842305 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-e5df5757-e132-4124-99e8-032a662e7788 req-ac2e60f0-2404-487f-a8e3-8a69ac2a4033 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:48.842750 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-e5df5757-e132-4124-99e8-032a662e7788 req-ac2e60f0-2404-487f-a8e3-8a69ac2a4033 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:48.878290 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-e5df5757-e132-4124-99e8-032a662e7788 req-ac2e60f0-2404-487f-a8e3-8a69ac2a4033 service nova] Creating event network-vif-plugged:7733954e-5190-40f9-8b4f-c132526b121a for instance 2d6c38be-13a5-4c57-badb-c4371acfb34c on hv-cinder-81914 Feb 15 14:24:48.894822 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-e5df5757-e132-4124-99e8-032a662e7788 req-ac2e60f0-2404-487f-a8e3-8a69ac2a4033 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157698 Feb 15 14:24:48.897025 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 44/93] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:24:48.968877 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-301b4786-b213-45be-9d33-156868c872f8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:48.980857 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-301b4786-b213-45be-9d33-156868c872f8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1322 microversion: 2.1 time: 0.323102 Feb 15 14:24:48.981539 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 50/94] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:48 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:49.116371 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-342725ec-52db-4ff8-a463-03bcecb081bd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:49.117247 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-342725ec-52db-4ff8-a463-03bcecb081bd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:49.123690 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-342725ec-52db-4ff8-a463-03bcecb081bd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:49.124266 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-342725ec-52db-4ff8-a463-03bcecb081bd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:49.125234 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-342725ec-52db-4ff8-a463-03bcecb081bd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:49.126426 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-342725ec-52db-4ff8-a463-03bcecb081bd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:49.318101 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-342725ec-52db-4ff8-a463-03bcecb081bd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:49.333502 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-342725ec-52db-4ff8-a463-03bcecb081bd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:49.335145 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-342725ec-52db-4ff8-a463-03bcecb081bd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:49.336359 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-342725ec-52db-4ff8-a463-03bcecb081bd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1407 microversion: 2.20 time: 0.224351 Feb 15 14:24:49.347397 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 45/95] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:24:49 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:24:49.474029 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-5343fb8c-8af6-49f0-92a5-31290f53713d tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:49.474639 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-5343fb8c-8af6-49f0-92a5-31290f53713d tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:49.483143 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5343fb8c-8af6-49f0-92a5-31290f53713d tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:49.484050 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5343fb8c-8af6-49f0-92a5-31290f53713d tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:49.485980 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5343fb8c-8af6-49f0-92a5-31290f53713d tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:49.486864 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5343fb8c-8af6-49f0-92a5-31290f53713d tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:49.515301 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-36c9cd22-d0c6-4cf0-bccd-b401e8f5c9fc tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:49.517365 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-36c9cd22-d0c6-4cf0-bccd-b401e8f5c9fc tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:49.525877 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-36c9cd22-d0c6-4cf0-bccd-b401e8f5c9fc tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:49.534132 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-36c9cd22-d0c6-4cf0-bccd-b401e8f5c9fc tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:49.535568 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-36c9cd22-d0c6-4cf0-bccd-b401e8f5c9fc tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:49.536142 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-36c9cd22-d0c6-4cf0-bccd-b401e8f5c9fc tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:49.721690 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-5343fb8c-8af6-49f0-92a5-31290f53713d tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:49.729782 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-5343fb8c-8af6-49f0-92a5-31290f53713d tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1315 microversion: 2.1 time: 0.259938 Feb 15 14:24:49.733368 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 51/96] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:49 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:49.772159 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-36c9cd22-d0c6-4cf0-bccd-b401e8f5c9fc tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:49.781540 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-36c9cd22-d0c6-4cf0-bccd-b401e8f5c9fc tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 200 len: 1318 microversion: 2.1 time: 0.272303 Feb 15 14:24:49.794860 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 46/97] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:49 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:24:49.997193 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-0f7c6311-28f8-48f5-9dcc-932a33e9f8f9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:49.997795 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-0f7c6311-28f8-48f5-9dcc-932a33e9f8f9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:50.007300 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0f7c6311-28f8-48f5-9dcc-932a33e9f8f9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:50.007862 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0f7c6311-28f8-48f5-9dcc-932a33e9f8f9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:50.008817 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0f7c6311-28f8-48f5-9dcc-932a33e9f8f9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:50.009512 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0f7c6311-28f8-48f5-9dcc-932a33e9f8f9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:50.176567 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-0f7c6311-28f8-48f5-9dcc-932a33e9f8f9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:50.190249 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-0f7c6311-28f8-48f5-9dcc-932a33e9f8f9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1322 microversion: 2.1 time: 0.196626 Feb 15 14:24:50.201083 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 52/98] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:49 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:50.355802 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-23ef16a1-fae2-42d5-8c09-9b407cdc8f86 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:50.356515 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-23ef16a1-fae2-42d5-8c09-9b407cdc8f86 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:50.372759 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-23ef16a1-fae2-42d5-8c09-9b407cdc8f86 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:50.372759 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-23ef16a1-fae2-42d5-8c09-9b407cdc8f86 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:50.372759 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-23ef16a1-fae2-42d5-8c09-9b407cdc8f86 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:50.372759 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-23ef16a1-fae2-42d5-8c09-9b407cdc8f86 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:50.630951 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-23ef16a1-fae2-42d5-8c09-9b407cdc8f86 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:50.639490 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-23ef16a1-fae2-42d5-8c09-9b407cdc8f86 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:50.642007 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-23ef16a1-fae2-42d5-8c09-9b407cdc8f86 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:50.643139 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-23ef16a1-fae2-42d5-8c09-9b407cdc8f86 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1407 microversion: 2.20 time: 0.291987 Feb 15 14:24:50.643693 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 47/99] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:24:50 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:24:50.749996 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-c04175eb-6a1a-489b-b647-30d647785fff tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:50.751217 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-c04175eb-6a1a-489b-b647-30d647785fff tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:50.760922 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c04175eb-6a1a-489b-b647-30d647785fff tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:50.761376 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c04175eb-6a1a-489b-b647-30d647785fff tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:50.767083 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c04175eb-6a1a-489b-b647-30d647785fff tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:50.769312 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c04175eb-6a1a-489b-b647-30d647785fff tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:50.801773 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-c3a11905-36a3-49c4-b1af-28c2f89d733c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:50.802582 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-c3a11905-36a3-49c4-b1af-28c2f89d733c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:50.811469 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c3a11905-36a3-49c4-b1af-28c2f89d733c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:50.812142 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c3a11905-36a3-49c4-b1af-28c2f89d733c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:50.815200 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c3a11905-36a3-49c4-b1af-28c2f89d733c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:50.816575 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c3a11905-36a3-49c4-b1af-28c2f89d733c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:51.028611 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-c3a11905-36a3-49c4-b1af-28c2f89d733c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:51.039282 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-c3a11905-36a3-49c4-b1af-28c2f89d733c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 200 len: 1318 microversion: 2.1 time: 0.241107 Feb 15 14:24:51.039697 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 48/100] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:50 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:24:51.041603 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-c04175eb-6a1a-489b-b647-30d647785fff tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:51.044532 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-a876572c-a3e5-4bcf-ae5a-3d831ac9232d req-e593629d-3610-4541-878c-09eeb6ff1053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c5ab4c-5386-4e98-a890-434b75b6fa0f", "name": "network-vif-plugged", "status": "completed", "tag": "9cc8b6d0-5c94-45c4-86e5-52e57da30c8f"}, {"server_uuid": "13edf4fd-20da-43ce-bb58-5757dc0f96c7", "name": "network-vif-plugged", "status": "completed", "tag": "09e7ae20-efee-4ba4-bc83-98bd05f41729"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:24:51.046684 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:24:51.046684 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:24:51.049704 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-c04175eb-6a1a-489b-b647-30d647785fff tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1315 microversion: 2.1 time: 0.304230 Feb 15 14:24:51.050485 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 53/101] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:50 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:51.057888 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-a876572c-a3e5-4bcf-ae5a-3d831ac9232d req-e593629d-3610-4541-878c-09eeb6ff1053 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:51.058515 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-a876572c-a3e5-4bcf-ae5a-3d831ac9232d req-e593629d-3610-4541-878c-09eeb6ff1053 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:51.074109 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-a876572c-a3e5-4bcf-ae5a-3d831ac9232d req-e593629d-3610-4541-878c-09eeb6ff1053 service nova] Creating event network-vif-plugged:9cc8b6d0-5c94-45c4-86e5-52e57da30c8f for instance f5c5ab4c-5386-4e98-a890-434b75b6fa0f on hv-cinder-81914 Feb 15 14:24:51.074630 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-a876572c-a3e5-4bcf-ae5a-3d831ac9232d req-e593629d-3610-4541-878c-09eeb6ff1053 service nova] Creating event network-vif-plugged:09e7ae20-efee-4ba4-bc83-98bd05f41729 for instance 13edf4fd-20da-43ce-bb58-5757dc0f96c7 on hv-cinder-81914 Feb 15 14:24:51.081417 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-a876572c-a3e5-4bcf-ae5a-3d831ac9232d req-e593629d-3610-4541-878c-09eeb6ff1053 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040354 Feb 15 14:24:51.082136 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 49/102] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:24:51.212995 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-b9ade113-71ac-429c-b03e-186f82f1a5a6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:51.215078 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-b9ade113-71ac-429c-b03e-186f82f1a5a6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:51.231772 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b9ade113-71ac-429c-b03e-186f82f1a5a6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:51.232525 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b9ade113-71ac-429c-b03e-186f82f1a5a6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:51.239417 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b9ade113-71ac-429c-b03e-186f82f1a5a6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:51.240188 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b9ade113-71ac-429c-b03e-186f82f1a5a6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:51.542815 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-b9ade113-71ac-429c-b03e-186f82f1a5a6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:51.556426 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-b9ade113-71ac-429c-b03e-186f82f1a5a6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1322 microversion: 2.1 time: 0.349465 Feb 15 14:24:51.557249 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 54/103] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:51 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1322 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:51.664555 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-faf95fdc-70c8-41d6-b623-ce50c36c4fff tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:51.665957 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-faf95fdc-70c8-41d6-b623-ce50c36c4fff tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:51.674378 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-faf95fdc-70c8-41d6-b623-ce50c36c4fff tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:51.675046 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-faf95fdc-70c8-41d6-b623-ce50c36c4fff tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:51.676009 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-faf95fdc-70c8-41d6-b623-ce50c36c4fff tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:51.676627 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-faf95fdc-70c8-41d6-b623-ce50c36c4fff tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:51.864189 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-faf95fdc-70c8-41d6-b623-ce50c36c4fff tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:51.879940 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-faf95fdc-70c8-41d6-b623-ce50c36c4fff tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:51.881641 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-faf95fdc-70c8-41d6-b623-ce50c36c4fff tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:51.883204 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-faf95fdc-70c8-41d6-b623-ce50c36c4fff tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1407 microversion: 2.20 time: 0.224359 Feb 15 14:24:51.883939 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 50/104] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:24:51 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:24:52.056145 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-6506556f-9f51-4c7b-939c-60347aa37f20 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:52.057191 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-6506556f-9f51-4c7b-939c-60347aa37f20 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:52.067880 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-e84188c0-2420-4b50-8e80-c1a2ad43e7bc tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:52.068953 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-e84188c0-2420-4b50-8e80-c1a2ad43e7bc tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:52.075582 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6506556f-9f51-4c7b-939c-60347aa37f20 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:52.076308 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6506556f-9f51-4c7b-939c-60347aa37f20 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:52.077194 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6506556f-9f51-4c7b-939c-60347aa37f20 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:52.079070 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e84188c0-2420-4b50-8e80-c1a2ad43e7bc tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:52.079676 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6506556f-9f51-4c7b-939c-60347aa37f20 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:52.082086 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e84188c0-2420-4b50-8e80-c1a2ad43e7bc tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:52.084148 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e84188c0-2420-4b50-8e80-c1a2ad43e7bc tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:52.084633 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e84188c0-2420-4b50-8e80-c1a2ad43e7bc tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:52.398506 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-6506556f-9f51-4c7b-939c-60347aa37f20 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:52.409191 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-e84188c0-2420-4b50-8e80-c1a2ad43e7bc tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:52.417907 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-6506556f-9f51-4c7b-939c-60347aa37f20 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 200 len: 1507 microversion: 2.1 time: 0.366141 Feb 15 14:24:52.419839 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 55/105] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:52 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 1507 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:52.424036 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-e84188c0-2420-4b50-8e80-c1a2ad43e7bc tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1315 microversion: 2.1 time: 0.360357 Feb 15 14:24:52.425423 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 51/106] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:52 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:24:52.574058 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-310148b8-da15-4148-a8c5-c2475774dad5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:52.575305 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-310148b8-da15-4148-a8c5-c2475774dad5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:52.583126 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-310148b8-da15-4148-a8c5-c2475774dad5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:52.583852 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-310148b8-da15-4148-a8c5-c2475774dad5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:52.584893 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-310148b8-da15-4148-a8c5-c2475774dad5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:52.585473 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-310148b8-da15-4148-a8c5-c2475774dad5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:52.751314 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-310148b8-da15-4148-a8c5-c2475774dad5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:52.759269 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-310148b8-da15-4148-a8c5-c2475774dad5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1322 microversion: 2.1 time: 0.189259 Feb 15 14:24:52.760026 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 56/107] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:52 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:52.903339 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-ec3e76b6-f099-45da-b25a-8bc0f3f78abd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:52.903947 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-ec3e76b6-f099-45da-b25a-8bc0f3f78abd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:52.914124 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ec3e76b6-f099-45da-b25a-8bc0f3f78abd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:52.914814 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ec3e76b6-f099-45da-b25a-8bc0f3f78abd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:52.915588 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ec3e76b6-f099-45da-b25a-8bc0f3f78abd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:52.916020 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ec3e76b6-f099-45da-b25a-8bc0f3f78abd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:53.080577 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-ec3e76b6-f099-45da-b25a-8bc0f3f78abd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:53.089411 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-ec3e76b6-f099-45da-b25a-8bc0f3f78abd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:53.090906 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-ec3e76b6-f099-45da-b25a-8bc0f3f78abd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:53.092172 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-ec3e76b6-f099-45da-b25a-8bc0f3f78abd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1407 microversion: 2.20 time: 0.194465 Feb 15 14:24:53.104001 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 52/108] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:24:52 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:24:53.454791 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-27bc075b-3368-42c5-8b8c-72990f6c8936 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:53.458848 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-27bc075b-3368-42c5-8b8c-72990f6c8936 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:53.466376 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-27bc075b-3368-42c5-8b8c-72990f6c8936 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:53.467046 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-27bc075b-3368-42c5-8b8c-72990f6c8936 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:53.468375 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-27bc075b-3368-42c5-8b8c-72990f6c8936 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:53.470308 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-27bc075b-3368-42c5-8b8c-72990f6c8936 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:53.666070 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-27bc075b-3368-42c5-8b8c-72990f6c8936 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:53.679153 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-27bc075b-3368-42c5-8b8c-72990f6c8936 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1315 microversion: 2.1 time: 0.226313 Feb 15 14:24:53.686415 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 57/109] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:53 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:53.777725 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-8b2ff579-e62d-400c-a223-bec3b8bbcc96 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:53.778320 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-8b2ff579-e62d-400c-a223-bec3b8bbcc96 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:53.786654 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8b2ff579-e62d-400c-a223-bec3b8bbcc96 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:53.789486 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8b2ff579-e62d-400c-a223-bec3b8bbcc96 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:53.791469 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8b2ff579-e62d-400c-a223-bec3b8bbcc96 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:53.793047 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8b2ff579-e62d-400c-a223-bec3b8bbcc96 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:53.997180 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-f49a98ac-81f9-47a0-ad12-5c84a94498e4 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "874ebbec-7220-4a48-b013-103ae6fc6f01"}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:24:53.998768 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-f49a98ac-81f9-47a0-ad12-5c84a94498e4 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:54.005940 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f49a98ac-81f9-47a0-ad12-5c84a94498e4 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:54.006587 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f49a98ac-81f9-47a0-ad12-5c84a94498e4 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:54.007802 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f49a98ac-81f9-47a0-ad12-5c84a94498e4 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:54.009344 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-8b2ff579-e62d-400c-a223-bec3b8bbcc96 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:54.016221 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f49a98ac-81f9-47a0-ad12-5c84a94498e4 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:54.020428 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-8b2ff579-e62d-400c-a223-bec3b8bbcc96 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1322 microversion: 2.1 time: 0.245871 Feb 15 14:24:54.022490 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 53/110] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:53 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:54.113498 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-4dcf26ff-202a-4299-bdcb-84a01837e9d2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:54.114686 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-4dcf26ff-202a-4299-bdcb-84a01837e9d2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:54.130685 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4dcf26ff-202a-4299-bdcb-84a01837e9d2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:54.131176 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4dcf26ff-202a-4299-bdcb-84a01837e9d2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:54.140436 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4dcf26ff-202a-4299-bdcb-84a01837e9d2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:54.145945 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4dcf26ff-202a-4299-bdcb-84a01837e9d2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:54.374238 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-4dcf26ff-202a-4299-bdcb-84a01837e9d2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:54.384098 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-4dcf26ff-202a-4299-bdcb-84a01837e9d2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:54.386278 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-4dcf26ff-202a-4299-bdcb-84a01837e9d2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:54.389655 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-4dcf26ff-202a-4299-bdcb-84a01837e9d2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1407 microversion: 2.20 time: 0.283118 Feb 15 14:24:54.390283 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 54/111] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:24:54 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 14:24:54.410127 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-c20ac12a-ab89-4026-8fe7-cac96d35d398 req-5c64edeb-8158-4a48-aaf6-282bf1492c41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da335cfa-e017-4c76-b734-1aa9f65add13", "name": "network-vif-plugged", "status": "completed", "tag": "9aa04bc6-dbe4-47a7-b359-c0906fd2d893"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:24:54.412281 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:24:54.412281 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:24:54.420119 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-c20ac12a-ab89-4026-8fe7-cac96d35d398 req-5c64edeb-8158-4a48-aaf6-282bf1492c41 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:54.420957 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-c20ac12a-ab89-4026-8fe7-cac96d35d398 req-5c64edeb-8158-4a48-aaf6-282bf1492c41 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:54.439719 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-c20ac12a-ab89-4026-8fe7-cac96d35d398 req-5c64edeb-8158-4a48-aaf6-282bf1492c41 service nova] Creating event network-vif-plugged:9aa04bc6-dbe4-47a7-b359-c0906fd2d893 for instance da335cfa-e017-4c76-b734-1aa9f65add13 on hv-cinder-81914 Feb 15 14:24:54.449204 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-c20ac12a-ab89-4026-8fe7-cac96d35d398 req-5c64edeb-8158-4a48-aaf6-282bf1492c41 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045498 Feb 15 14:24:54.450495 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 55/112] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:24:54.537321 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-f49a98ac-81f9-47a0-ad12-5c84a94498e4 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "POST /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.543490 Feb 15 14:24:54.537995 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 58/113] 10.222.0.83 () {60 vars in 1322 bytes} [Tue Feb 15 14:24:53 2022] POST /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c/os-volume_attachments => generated 194 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:24:54.697534 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-dab576c9-d1f1-4dd3-89de-781622d6b654 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:54.698309 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-dab576c9-d1f1-4dd3-89de-781622d6b654 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:54.721680 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-dab576c9-d1f1-4dd3-89de-781622d6b654 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:54.722132 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-dab576c9-d1f1-4dd3-89de-781622d6b654 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:54.727263 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-dab576c9-d1f1-4dd3-89de-781622d6b654 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:54.727728 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-dab576c9-d1f1-4dd3-89de-781622d6b654 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:54.903846 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-dab576c9-d1f1-4dd3-89de-781622d6b654 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:54.912057 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-dab576c9-d1f1-4dd3-89de-781622d6b654 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1502 microversion: 2.1 time: 0.218955 Feb 15 14:24:54.912702 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 56/114] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:54 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1502 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:24:55.040023 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-53a16694-a9ac-4c7f-9c45-af7cab1e16f0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:55.040759 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-53a16694-a9ac-4c7f-9c45-af7cab1e16f0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:55.050501 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-53a16694-a9ac-4c7f-9c45-af7cab1e16f0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:55.051560 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-53a16694-a9ac-4c7f-9c45-af7cab1e16f0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:55.052813 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-53a16694-a9ac-4c7f-9c45-af7cab1e16f0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:55.053579 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-53a16694-a9ac-4c7f-9c45-af7cab1e16f0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:55.409413 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-6514937e-f092-46ee-b04a-ec91909c298b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:55.410709 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-6514937e-f092-46ee-b04a-ec91909c298b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:55.419766 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6514937e-f092-46ee-b04a-ec91909c298b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:55.420426 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6514937e-f092-46ee-b04a-ec91909c298b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:55.421412 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6514937e-f092-46ee-b04a-ec91909c298b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:55.422012 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6514937e-f092-46ee-b04a-ec91909c298b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:55.481883 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-53a16694-a9ac-4c7f-9c45-af7cab1e16f0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:55.489690 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-53a16694-a9ac-4c7f-9c45-af7cab1e16f0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1322 microversion: 2.1 time: 0.454585 Feb 15 14:24:55.490271 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 59/115] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:55 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1322 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:55.628172 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-6514937e-f092-46ee-b04a-ec91909c298b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:55.637518 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-6514937e-f092-46ee-b04a-ec91909c298b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:55.639146 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-6514937e-f092-46ee-b04a-ec91909c298b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:55.640538 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-6514937e-f092-46ee-b04a-ec91909c298b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1407 microversion: 2.20 time: 0.234968 Feb 15 14:24:55.643499 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 57/116] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:24:55 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 14:24:56.391450 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-fac1d490-6c64-4afa-be98-31944e62dc4f tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97bfdf02-835f-433b-9e0e-025f68427064"}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:24:56.393738 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-fac1d490-6c64-4afa-be98-31944e62dc4f tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:56.401876 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-fac1d490-6c64-4afa-be98-31944e62dc4f tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:56.403686 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-fac1d490-6c64-4afa-be98-31944e62dc4f tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:56.404846 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-fac1d490-6c64-4afa-be98-31944e62dc4f tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:56.406048 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-fac1d490-6c64-4afa-be98-31944e62dc4f tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:56.480657 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-ffc2ddce-b64d-42b8-a0e2-b95ea0272538 req-b43988de-41c2-494c-8e19-c53fc9751039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c04d927-9f34-4f11-8502-7175a64e3923", "name": "network-vif-plugged", "status": "completed", "tag": "23ef841c-69a3-483c-9bb9-680e3d5b6392"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:24:56.482964 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:24:56.482964 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:24:56.504054 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-ffc2ddce-b64d-42b8-a0e2-b95ea0272538 req-b43988de-41c2-494c-8e19-c53fc9751039 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:56.504775 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-ffc2ddce-b64d-42b8-a0e2-b95ea0272538 req-b43988de-41c2-494c-8e19-c53fc9751039 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:56.522150 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-ffc2ddce-b64d-42b8-a0e2-b95ea0272538 req-b43988de-41c2-494c-8e19-c53fc9751039 service nova] Creating event network-vif-plugged:23ef841c-69a3-483c-9bb9-680e3d5b6392 for instance 9c04d927-9f34-4f11-8502-7175a64e3923 on hv-cinder-81914 Feb 15 14:24:56.527949 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-ffc2ddce-b64d-42b8-a0e2-b95ea0272538 req-b43988de-41c2-494c-8e19-c53fc9751039 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053281 Feb 15 14:24:56.528728 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 58/117] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:24:56.537280 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-d97382a2-9996-402b-ae35-ce96a367959e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:56.538563 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-d97382a2-9996-402b-ae35-ce96a367959e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:56.545491 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d97382a2-9996-402b-ae35-ce96a367959e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:56.546233 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d97382a2-9996-402b-ae35-ce96a367959e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:56.548872 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d97382a2-9996-402b-ae35-ce96a367959e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:56.549542 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d97382a2-9996-402b-ae35-ce96a367959e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:56.866677 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-fac1d490-6c64-4afa-be98-31944e62dc4f tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "POST /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.480732 Feb 15 14:24:56.867560 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 60/118] 10.222.0.83 () {60 vars in 1322 bytes} [Tue Feb 15 14:24:56 2022] POST /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f/os-volume_attachments => generated 194 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:24:56.876649 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-5ed68210-28fd-41bd-9a33-648f7778cecb tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:56.877814 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-5ed68210-28fd-41bd-9a33-648f7778cecb tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:56.886232 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5ed68210-28fd-41bd-9a33-648f7778cecb tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:56.886889 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5ed68210-28fd-41bd-9a33-648f7778cecb tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:56.887909 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5ed68210-28fd-41bd-9a33-648f7778cecb tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:56.888529 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5ed68210-28fd-41bd-9a33-648f7778cecb tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:56.920866 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-d97382a2-9996-402b-ae35-ce96a367959e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:56.933841 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-d97382a2-9996-402b-ae35-ce96a367959e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1322 microversion: 2.1 time: 0.403578 Feb 15 14:24:56.941882 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 59/119] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:56 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1322 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:57.166771 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-5ed68210-28fd-41bd-9a33-648f7778cecb tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:57.176345 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-5ed68210-28fd-41bd-9a33-648f7778cecb tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:57.181497 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-5ed68210-28fd-41bd-9a33-648f7778cecb tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:57.182628 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-5ed68210-28fd-41bd-9a33-648f7778cecb tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1407 microversion: 2.20 time: 0.313977 Feb 15 14:24:57.183195 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 61/120] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:24:56 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:24:57.952563 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-459a97d6-268d-4dfd-809f-4b5d014a7684 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:57.953227 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-459a97d6-268d-4dfd-809f-4b5d014a7684 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:57.960552 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-459a97d6-268d-4dfd-809f-4b5d014a7684 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:57.961321 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-459a97d6-268d-4dfd-809f-4b5d014a7684 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:57.962322 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-459a97d6-268d-4dfd-809f-4b5d014a7684 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:57.962956 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-459a97d6-268d-4dfd-809f-4b5d014a7684 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:58.199823 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-57d184bd-ba50-4381-a2f9-9f595066cf7c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:58.200568 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-57d184bd-ba50-4381-a2f9-9f595066cf7c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:58.221408 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-57d184bd-ba50-4381-a2f9-9f595066cf7c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:58.221865 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-57d184bd-ba50-4381-a2f9-9f595066cf7c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:58.226165 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-57d184bd-ba50-4381-a2f9-9f595066cf7c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:58.228003 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-57d184bd-ba50-4381-a2f9-9f595066cf7c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:58.237513 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-459a97d6-268d-4dfd-809f-4b5d014a7684 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:58.246226 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-459a97d6-268d-4dfd-809f-4b5d014a7684 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1515 microversion: 2.1 time: 0.297873 Feb 15 14:24:58.258845 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 60/121] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:57 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1515 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:58.264059 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-4d02f3a1-a058-417d-bf69-f68d25eea27b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:24:58.265350 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-4d02f3a1-a058-417d-bf69-f68d25eea27b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:58.271987 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4d02f3a1-a058-417d-bf69-f68d25eea27b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:58.272784 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4d02f3a1-a058-417d-bf69-f68d25eea27b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:58.273783 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4d02f3a1-a058-417d-bf69-f68d25eea27b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:58.274575 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4d02f3a1-a058-417d-bf69-f68d25eea27b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:58.348335 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.objects.instance [None req-4d02f3a1-a058-417d-bf69-f68d25eea27b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lazy-loading 'flavor' on Instance uuid da335cfa-e017-4c76-b734-1aa9f65add13 {{(pid=116362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:24:58.412962 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-57d184bd-ba50-4381-a2f9-9f595066cf7c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:58.421372 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-57d184bd-ba50-4381-a2f9-9f595066cf7c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:58.425128 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-57d184bd-ba50-4381-a2f9-9f595066cf7c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:58.426260 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-57d184bd-ba50-4381-a2f9-9f595066cf7c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1407 microversion: 2.20 time: 0.230453 Feb 15 14:24:58.427379 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 62/122] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:24:58 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:24:58.488866 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-4d02f3a1-a058-417d-bf69-f68d25eea27b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "POST /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13/action" status: 200 len: 32 microversion: 2.1 time: 0.228456 Feb 15 14:24:58.489567 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 61/123] 10.222.0.83 () {60 vars in 1277 bytes} [Tue Feb 15 14:24:58 2022] POST /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13/action => generated 32 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 14:24:58.499834 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-04d8ae30-cf66-4fa1-90d3-53a494696a0f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:58.500765 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-04d8ae30-cf66-4fa1-90d3-53a494696a0f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:58.507936 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-04d8ae30-cf66-4fa1-90d3-53a494696a0f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:58.508386 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-04d8ae30-cf66-4fa1-90d3-53a494696a0f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:58.509196 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-04d8ae30-cf66-4fa1-90d3-53a494696a0f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:58.509770 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-04d8ae30-cf66-4fa1-90d3-53a494696a0f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:58.784364 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-04d8ae30-cf66-4fa1-90d3-53a494696a0f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:58.805117 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-04d8ae30-cf66-4fa1-90d3-53a494696a0f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.309266 Feb 15 14:24:58.806253 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 63/124] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:58 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:24:59.445051 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-be810dba-5863-4b90-8230-e7c171cba522 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:59.445734 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-be810dba-5863-4b90-8230-e7c171cba522 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:59.452683 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-be810dba-5863-4b90-8230-e7c171cba522 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:59.453711 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-be810dba-5863-4b90-8230-e7c171cba522 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:59.455441 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-be810dba-5863-4b90-8230-e7c171cba522 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:59.456025 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-be810dba-5863-4b90-8230-e7c171cba522 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:59.624230 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-be810dba-5863-4b90-8230-e7c171cba522 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:59.635586 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-be810dba-5863-4b90-8230-e7c171cba522 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:59.637399 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-be810dba-5863-4b90-8230-e7c171cba522 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:24:59.639116 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-be810dba-5863-4b90-8230-e7c171cba522 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1598 microversion: 2.20 time: 0.197530 Feb 15 14:24:59.639968 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 62/125] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:24:59 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1598 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:24:59.658831 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-71dddab1-7d97-4043-a184-6be0e2abad9b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:59.659872 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-71dddab1-7d97-4043-a184-6be0e2abad9b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:59.666100 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-71dddab1-7d97-4043-a184-6be0e2abad9b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:59.666540 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-71dddab1-7d97-4043-a184-6be0e2abad9b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:59.667307 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-71dddab1-7d97-4043-a184-6be0e2abad9b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:59.667731 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-71dddab1-7d97-4043-a184-6be0e2abad9b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:59.778961 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-71dddab1-7d97-4043-a184-6be0e2abad9b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.122972 Feb 15 14:24:59.781073 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 64/126] 10.222.0.83 () {60 vars in 1315 bytes} [Tue Feb 15 14:24:59 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 14:24:59.823383 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-58eb00e5-7432-4cd8-ae63-53e1ef733ec6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:24:59.824173 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-58eb00e5-7432-4cd8-ae63-53e1ef733ec6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:24:59.832840 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-58eb00e5-7432-4cd8-ae63-53e1ef733ec6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:59.833625 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-58eb00e5-7432-4cd8-ae63-53e1ef733ec6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:24:59.835264 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-58eb00e5-7432-4cd8-ae63-53e1ef733ec6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:24:59.836317 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-58eb00e5-7432-4cd8-ae63-53e1ef733ec6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:00.243082 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-58eb00e5-7432-4cd8-ae63-53e1ef733ec6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:00.251437 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-58eb00e5-7432-4cd8-ae63-53e1ef733ec6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.432974 Feb 15 14:25:00.252338 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 63/127] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:24:59 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:01.272947 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-650becc1-3157-465b-8a6e-1cde943e52f8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:01.273539 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-650becc1-3157-465b-8a6e-1cde943e52f8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:01.280267 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-650becc1-3157-465b-8a6e-1cde943e52f8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:01.285036 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-650becc1-3157-465b-8a6e-1cde943e52f8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:01.286123 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-650becc1-3157-465b-8a6e-1cde943e52f8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:01.286851 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-650becc1-3157-465b-8a6e-1cde943e52f8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:01.550575 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-650becc1-3157-465b-8a6e-1cde943e52f8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:01.579985 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-650becc1-3157-465b-8a6e-1cde943e52f8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.310811 Feb 15 14:25:01.581502 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 65/128] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:01 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:01.645325 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-eced49a8-cd91-4e0e-b7db-6dbe5fa64dc3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:01.647254 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-eced49a8-cd91-4e0e-b7db-6dbe5fa64dc3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:01.647462 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-f4fb6e94-bfb9-43a9-8036-a7bbffbaf066 req-76957767-dc89-4d8e-a531-bf7e870f3123 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c04d927-9f34-4f11-8502-7175a64e3923", "tag": "23ef841c-69a3-483c-9bb9-680e3d5b6392"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:25:01.652249 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:25:01.652249 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:25:01.666599 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-eced49a8-cd91-4e0e-b7db-6dbe5fa64dc3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:01.667130 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-eced49a8-cd91-4e0e-b7db-6dbe5fa64dc3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:01.667590 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-f4fb6e94-bfb9-43a9-8036-a7bbffbaf066 req-76957767-dc89-4d8e-a531-bf7e870f3123 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:01.667915 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-f4fb6e94-bfb9-43a9-8036-a7bbffbaf066 req-76957767-dc89-4d8e-a531-bf7e870f3123 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:01.668792 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-eced49a8-cd91-4e0e-b7db-6dbe5fa64dc3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:01.670307 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-eced49a8-cd91-4e0e-b7db-6dbe5fa64dc3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:01.681780 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-f4fb6e94-bfb9-43a9-8036-a7bbffbaf066 req-76957767-dc89-4d8e-a531-bf7e870f3123 service nova] Creating event network-changed:23ef841c-69a3-483c-9bb9-680e3d5b6392 for instance 9c04d927-9f34-4f11-8502-7175a64e3923 on hv-cinder-81914 Feb 15 14:25:01.692682 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-f4fb6e94-bfb9-43a9-8036-a7bbffbaf066 req-76957767-dc89-4d8e-a531-bf7e870f3123 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052237 Feb 15 14:25:01.716231 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 66/129] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:25:01.721249 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-eced49a8-cd91-4e0e-b7db-6dbe5fa64dc3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923/ips" status: 200 len: 111 microversion: 2.20 time: 0.086699 Feb 15 14:25:01.727278 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 64/130] 10.222.0.83 () {60 vars in 1288 bytes} [Tue Feb 15 14:25:01 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923/ips => generated 111 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 14:25:02.598793 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-cfe66d58-8ca7-49e9-9319-f5c1aed7a423 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:02.600141 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-cfe66d58-8ca7-49e9-9319-f5c1aed7a423 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:02.606739 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-cfe66d58-8ca7-49e9-9319-f5c1aed7a423 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:02.607404 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-cfe66d58-8ca7-49e9-9319-f5c1aed7a423 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:02.608417 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-cfe66d58-8ca7-49e9-9319-f5c1aed7a423 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:02.608850 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-cfe66d58-8ca7-49e9-9319-f5c1aed7a423 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:02.826678 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-cfe66d58-8ca7-49e9-9319-f5c1aed7a423 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:02.836484 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-cfe66d58-8ca7-49e9-9319-f5c1aed7a423 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.242490 Feb 15 14:25:02.847561 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 67/131] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:02 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:03.855154 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-e7d9d3a9-2c12-4f7e-9d73-a7e6d0580bd7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:03.855696 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-e7d9d3a9-2c12-4f7e-9d73-a7e6d0580bd7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:03.862926 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e7d9d3a9-2c12-4f7e-9d73-a7e6d0580bd7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:03.863368 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e7d9d3a9-2c12-4f7e-9d73-a7e6d0580bd7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:03.864321 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e7d9d3a9-2c12-4f7e-9d73-a7e6d0580bd7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:03.865567 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e7d9d3a9-2c12-4f7e-9d73-a7e6d0580bd7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:04.206312 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-e7d9d3a9-2c12-4f7e-9d73-a7e6d0580bd7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:04.220757 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-e7d9d3a9-2c12-4f7e-9d73-a7e6d0580bd7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.365029 Feb 15 14:25:04.227115 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 65/132] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:03 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:04.649806 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-89888656-e5fb-4e6c-8b82-9b6c16cc3083 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1179959535", "imageRef": "da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53", "flavorRef": "452", "networks": [{"uuid": "eff5572c-5ad3-47ef-8854-8018b7c6065d"}]}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:25:04.722207 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.network.neutron [None req-89888656-e5fb-4e6c-8b82-9b6c16cc3083 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] validate_networks() for [('eff5572c-5ad3-47ef-8854-8018b7c6065d', None, None, None, None, None)] {{(pid=116363) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 14:25:05.181613 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-89888656-e5fb-4e6c-8b82-9b6c16cc3083 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Flavor limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 14:25:05.182041 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-89888656-e5fb-4e6c-8b82-9b6c16cc3083 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Image limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 14:25:05.182546 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-89888656-e5fb-4e6c-8b82-9b6c16cc3083 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Flavor pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 14:25:05.182955 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-89888656-e5fb-4e6c-8b82-9b6c16cc3083 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Image pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 14:25:05.183367 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-89888656-e5fb-4e6c-8b82-9b6c16cc3083 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 14:25:05.237295 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-8230f040-23f3-4eae-a121-8a2b0101e327 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:05.240034 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-8230f040-23f3-4eae-a121-8a2b0101e327 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:05.249547 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8230f040-23f3-4eae-a121-8a2b0101e327 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:05.250615 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8230f040-23f3-4eae-a121-8a2b0101e327 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:05.252421 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8230f040-23f3-4eae-a121-8a2b0101e327 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:05.253188 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8230f040-23f3-4eae-a121-8a2b0101e327 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:05.339478 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-89888656-e5fb-4e6c-8b82-9b6c16cc3083 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:05.340033 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-89888656-e5fb-4e6c-8b82-9b6c16cc3083 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:05.341015 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-89888656-e5fb-4e6c-8b82-9b6c16cc3083 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:05.341556 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-89888656-e5fb-4e6c-8b82-9b6c16cc3083 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:05.362421 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-89888656-e5fb-4e6c-8b82-9b6c16cc3083 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Getting quotas for project b003f1ecbf4e4a32a99159d5b18a98ec. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:25:05.366925 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-89888656-e5fb-4e6c-8b82-9b6c16cc3083 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Getting quotas for user 9b50593d13054c9c8fdf463566f36b2e and project b003f1ecbf4e4a32a99159d5b18a98ec. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:25:05.382750 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-89888656-e5fb-4e6c-8b82-9b6c16cc3083 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Going to run 1 instances... {{(pid=116363) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 14:25:05.383092 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-89888656-e5fb-4e6c-8b82-9b6c16cc3083 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 14:25:05.419185 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-8230f040-23f3-4eae-a121-8a2b0101e327 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:05.428219 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-8230f040-23f3-4eae-a121-8a2b0101e327 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.197369 Feb 15 14:25:05.428877 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 66/133] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:05 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:05.444112 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-89888656-e5fb-4e6c-8b82-9b6c16cc3083 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.796810 Feb 15 14:25:05.445310 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 68/134] 10.222.0.83 () {60 vars in 1146 bytes} [Tue Feb 15 14:25:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 14:25:05.458756 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-289f2b86-5b24-4b32-ae4c-d5d0c786cfae tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:05.466468 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-289f2b86-5b24-4b32-ae4c-d5d0c786cfae tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:05.526252 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-289f2b86-5b24-4b32-ae4c-d5d0c786cfae tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:05.536520 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-289f2b86-5b24-4b32-ae4c-d5d0c786cfae tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57" status: 200 len: 1218 microversion: 2.1 time: 0.079778 Feb 15 14:25:05.537429 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 67/135] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:05 2022] GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:06.445967 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-c4abdcba-702d-4c44-8c81-5cce53c9bcc3 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:06.446569 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-c4abdcba-702d-4c44-8c81-5cce53c9bcc3 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:06.454439 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c4abdcba-702d-4c44-8c81-5cce53c9bcc3 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:06.455499 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c4abdcba-702d-4c44-8c81-5cce53c9bcc3 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:06.456281 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c4abdcba-702d-4c44-8c81-5cce53c9bcc3 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:06.456754 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c4abdcba-702d-4c44-8c81-5cce53c9bcc3 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:06.552965 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-db02e439-cca1-4cac-9d73-6adc0855c547 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:06.553576 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-db02e439-cca1-4cac-9d73-6adc0855c547 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:06.559744 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-db02e439-cca1-4cac-9d73-6adc0855c547 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:06.560192 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-db02e439-cca1-4cac-9d73-6adc0855c547 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:06.560999 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-db02e439-cca1-4cac-9d73-6adc0855c547 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:06.561433 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-db02e439-cca1-4cac-9d73-6adc0855c547 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:06.643527 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-c4abdcba-702d-4c44-8c81-5cce53c9bcc3 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:06.653426 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-db02e439-cca1-4cac-9d73-6adc0855c547 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:06.657288 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-c4abdcba-702d-4c44-8c81-5cce53c9bcc3 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.215550 Feb 15 14:25:06.658539 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 69/136] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:06 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:06.662385 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-db02e439-cca1-4cac-9d73-6adc0855c547 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57" status: 200 len: 1270 microversion: 2.1 time: 0.112989 Feb 15 14:25:06.663520 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 68/137] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:06 2022] GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57 => generated 1270 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:07.676162 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-7ad1d941-cc85-4760-9eb6-1f7cc67899d6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:07.676902 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-7ad1d941-cc85-4760-9eb6-1f7cc67899d6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:07.679714 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-0ba8d384-b553-4a60-bcf8-69cf63699019 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:07.680327 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-0ba8d384-b553-4a60-bcf8-69cf63699019 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:07.695899 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0ba8d384-b553-4a60-bcf8-69cf63699019 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:07.696509 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0ba8d384-b553-4a60-bcf8-69cf63699019 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:07.697297 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0ba8d384-b553-4a60-bcf8-69cf63699019 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:07.697444 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7ad1d941-cc85-4760-9eb6-1f7cc67899d6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:07.697726 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0ba8d384-b553-4a60-bcf8-69cf63699019 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:07.698001 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7ad1d941-cc85-4760-9eb6-1f7cc67899d6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:07.698855 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7ad1d941-cc85-4760-9eb6-1f7cc67899d6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:07.699354 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7ad1d941-cc85-4760-9eb6-1f7cc67899d6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:07.807285 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-0ba8d384-b553-4a60-bcf8-69cf63699019 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:07.816557 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-0ba8d384-b553-4a60-bcf8-69cf63699019 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57" status: 200 len: 1276 microversion: 2.1 time: 0.140196 Feb 15 14:25:07.818912 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 69/138] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:07 2022] GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:08.087882 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-7ad1d941-cc85-4760-9eb6-1f7cc67899d6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:08.100770 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-7ad1d941-cc85-4760-9eb6-1f7cc67899d6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.428380 Feb 15 14:25:08.106322 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 70/139] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:07 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:08.836196 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-fd431411-56c5-436c-9557-a416243c7681 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:08.836903 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-fd431411-56c5-436c-9557-a416243c7681 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:08.845099 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fd431411-56c5-436c-9557-a416243c7681 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:08.845599 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fd431411-56c5-436c-9557-a416243c7681 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:08.846609 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fd431411-56c5-436c-9557-a416243c7681 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:08.847042 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fd431411-56c5-436c-9557-a416243c7681 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:08.912630 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-495f692a-3182-4a68-882a-b6ee91b100b8 req-f21ac327-cb62-4b0d-bbc9-6524e2374bfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "949b517a-36a2-4f77-bf15-8ed3c1cfaf57", "tag": "391f41ba-b06d-4edb-9881-4d4c52a864ad"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:25:08.917421 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:25:08.917421 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:25:08.942981 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-495f692a-3182-4a68-882a-b6ee91b100b8 req-f21ac327-cb62-4b0d-bbc9-6524e2374bfb service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:08.946372 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-495f692a-3182-4a68-882a-b6ee91b100b8 req-f21ac327-cb62-4b0d-bbc9-6524e2374bfb service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:08.979551 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-495f692a-3182-4a68-882a-b6ee91b100b8 req-f21ac327-cb62-4b0d-bbc9-6524e2374bfb service nova] Creating event network-changed:391f41ba-b06d-4edb-9881-4d4c52a864ad for instance 949b517a-36a2-4f77-bf15-8ed3c1cfaf57 on hv-cinder-81914 Feb 15 14:25:08.995652 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-495f692a-3182-4a68-882a-b6ee91b100b8 req-f21ac327-cb62-4b0d-bbc9-6524e2374bfb service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093032 Feb 15 14:25:08.998250 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 71/140] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:25:09.111884 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-fd431411-56c5-436c-9557-a416243c7681 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:09.117098 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-19978797-4226-468a-8d6b-cf7efb755ca6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:09.118405 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-19978797-4226-468a-8d6b-cf7efb755ca6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:09.119322 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-fd431411-56c5-436c-9557-a416243c7681 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57" status: 200 len: 1318 microversion: 2.1 time: 0.286795 Feb 15 14:25:09.121411 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 70/141] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:08 2022] GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:09.129498 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-19978797-4226-468a-8d6b-cf7efb755ca6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:09.130162 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-19978797-4226-468a-8d6b-cf7efb755ca6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:09.130952 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-19978797-4226-468a-8d6b-cf7efb755ca6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:09.131395 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-19978797-4226-468a-8d6b-cf7efb755ca6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:09.681358 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-19978797-4226-468a-8d6b-cf7efb755ca6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:09.694382 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-19978797-4226-468a-8d6b-cf7efb755ca6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.579834 Feb 15 14:25:09.695292 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 72/142] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:09 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:10.139617 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-90f47679-edbd-4cf3-8a66-836a36afe75e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:10.141528 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-90f47679-edbd-4cf3-8a66-836a36afe75e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:10.168536 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-90f47679-edbd-4cf3-8a66-836a36afe75e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:10.168992 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-90f47679-edbd-4cf3-8a66-836a36afe75e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:10.182244 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-90f47679-edbd-4cf3-8a66-836a36afe75e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:10.182787 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-90f47679-edbd-4cf3-8a66-836a36afe75e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:10.412440 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-90f47679-edbd-4cf3-8a66-836a36afe75e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:10.423808 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-90f47679-edbd-4cf3-8a66-836a36afe75e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57" status: 200 len: 1318 microversion: 2.1 time: 0.289856 Feb 15 14:25:10.424537 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 71/143] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:10 2022] GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:10.711894 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-9189d45a-712a-428a-946c-878f7e7ae247 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:10.712697 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-9189d45a-712a-428a-946c-878f7e7ae247 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:10.719231 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9189d45a-712a-428a-946c-878f7e7ae247 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:10.719952 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9189d45a-712a-428a-946c-878f7e7ae247 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:10.720864 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9189d45a-712a-428a-946c-878f7e7ae247 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:10.721310 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9189d45a-712a-428a-946c-878f7e7ae247 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:10.881491 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-9189d45a-712a-428a-946c-878f7e7ae247 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:10.891514 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-9189d45a-712a-428a-946c-878f7e7ae247 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.182572 Feb 15 14:25:10.904573 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 73/144] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:10 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:11.441037 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-29158f13-20f0-460f-820c-3e6d5bfa1308 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:11.441754 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-29158f13-20f0-460f-820c-3e6d5bfa1308 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:11.448266 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-29158f13-20f0-460f-820c-3e6d5bfa1308 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:11.448748 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-29158f13-20f0-460f-820c-3e6d5bfa1308 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:11.449645 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-29158f13-20f0-460f-820c-3e6d5bfa1308 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:11.450168 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-29158f13-20f0-460f-820c-3e6d5bfa1308 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:11.688939 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-29158f13-20f0-460f-820c-3e6d5bfa1308 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:11.696788 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-29158f13-20f0-460f-820c-3e6d5bfa1308 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57" status: 200 len: 1318 microversion: 2.1 time: 0.260312 Feb 15 14:25:11.697365 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 72/145] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:11 2022] GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:11.909222 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-3fe8af3e-786d-4fbb-aeda-f1f0108c91d5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:11.909826 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-3fe8af3e-786d-4fbb-aeda-f1f0108c91d5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:11.923925 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3fe8af3e-786d-4fbb-aeda-f1f0108c91d5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:11.924738 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3fe8af3e-786d-4fbb-aeda-f1f0108c91d5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:11.925709 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3fe8af3e-786d-4fbb-aeda-f1f0108c91d5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:11.926306 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3fe8af3e-786d-4fbb-aeda-f1f0108c91d5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:12.132905 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-3fe8af3e-786d-4fbb-aeda-f1f0108c91d5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:12.164946 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-3fe8af3e-786d-4fbb-aeda-f1f0108c91d5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.259254 Feb 15 14:25:12.167740 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 74/146] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:11 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:12.396518 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-bb367387-b98f-4caa-9379-e58e2b4a8afd tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:12.397030 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-bb367387-b98f-4caa-9379-e58e2b4a8afd tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:12.407052 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bb367387-b98f-4caa-9379-e58e2b4a8afd tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:12.407585 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bb367387-b98f-4caa-9379-e58e2b4a8afd tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:12.408511 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bb367387-b98f-4caa-9379-e58e2b4a8afd tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:12.408990 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bb367387-b98f-4caa-9379-e58e2b4a8afd tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:12.454658 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-bb367387-b98f-4caa-9379-e58e2b4a8afd tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Going to try to terminate instance {{(pid=116362) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 14:25:12.557412 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-bb367387-b98f-4caa-9379-e58e2b4a8afd tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "DELETE /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 204 len: 0 microversion: 2.1 time: 0.164992 Feb 15 14:25:12.558810 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 73/147] 10.222.0.83 () {58 vars in 1238 bytes} [Tue Feb 15 14:25:12 2022] DELETE /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 14:25:12.569756 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-6cf054fb-2cba-40e7-956a-042177145b25 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:12.570758 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-6cf054fb-2cba-40e7-956a-042177145b25 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:12.578274 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6cf054fb-2cba-40e7-956a-042177145b25 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:12.578758 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6cf054fb-2cba-40e7-956a-042177145b25 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:12.579524 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6cf054fb-2cba-40e7-956a-042177145b25 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:12.579947 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6cf054fb-2cba-40e7-956a-042177145b25 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:12.716392 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-8da3878d-0403-410f-b2fe-e48935031f20 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:12.717279 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-8da3878d-0403-410f-b2fe-e48935031f20 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:12.720594 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-6cf054fb-2cba-40e7-956a-042177145b25 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:12.724474 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8da3878d-0403-410f-b2fe-e48935031f20 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:12.724912 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8da3878d-0403-410f-b2fe-e48935031f20 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:12.725703 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8da3878d-0403-410f-b2fe-e48935031f20 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:12.726131 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8da3878d-0403-410f-b2fe-e48935031f20 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:12.728758 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-6cf054fb-2cba-40e7-956a-042177145b25 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1554 microversion: 2.1 time: 0.164872 Feb 15 14:25:12.729332 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 75/148] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:12 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:12.883905 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-8da3878d-0403-410f-b2fe-e48935031f20 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:12.891983 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-8da3878d-0403-410f-b2fe-e48935031f20 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57" status: 200 len: 1318 microversion: 2.1 time: 0.181764 Feb 15 14:25:12.892596 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 74/149] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:12 2022] GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:13.182697 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-0a082f1d-6043-419d-8bf1-1a21c562bba6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:13.183305 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-0a082f1d-6043-419d-8bf1-1a21c562bba6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:13.189765 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0a082f1d-6043-419d-8bf1-1a21c562bba6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:13.190215 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0a082f1d-6043-419d-8bf1-1a21c562bba6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:13.191054 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0a082f1d-6043-419d-8bf1-1a21c562bba6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:13.191689 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0a082f1d-6043-419d-8bf1-1a21c562bba6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:13.323705 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-0a082f1d-6043-419d-8bf1-1a21c562bba6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:13.331800 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-0a082f1d-6043-419d-8bf1-1a21c562bba6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.152797 Feb 15 14:25:13.332371 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 76/150] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:13 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:13.746275 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-20074abb-c555-40d7-a19b-223e83a676a5 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:13.746878 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-20074abb-c555-40d7-a19b-223e83a676a5 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:13.755312 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-20074abb-c555-40d7-a19b-223e83a676a5 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:13.755761 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-20074abb-c555-40d7-a19b-223e83a676a5 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:13.756575 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-20074abb-c555-40d7-a19b-223e83a676a5 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:13.757007 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-20074abb-c555-40d7-a19b-223e83a676a5 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:13.909294 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-5b5602da-a9af-47e3-abb4-b7a4a8b5e427 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:13.910173 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-5b5602da-a9af-47e3-abb4-b7a4a8b5e427 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:13.926964 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5b5602da-a9af-47e3-abb4-b7a4a8b5e427 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:13.927688 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5b5602da-a9af-47e3-abb4-b7a4a8b5e427 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:13.928845 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5b5602da-a9af-47e3-abb4-b7a4a8b5e427 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:13.929479 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5b5602da-a9af-47e3-abb4-b7a4a8b5e427 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:13.976232 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-20074abb-c555-40d7-a19b-223e83a676a5 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:13.984959 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-20074abb-c555-40d7-a19b-223e83a676a5 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1554 microversion: 2.1 time: 0.242403 Feb 15 14:25:13.986051 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 75/151] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:13 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1554 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:13.991415 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-053c6380-a59e-4466-9930-438ab106313b tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-811568971", "imageRef": "da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53", "flavorRef": "452", "networks": [{"uuid": "ae35ad6c-d134-4864-852a-972a5c0cf360"}]}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:25:14.046675 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.network.neutron [None req-053c6380-a59e-4466-9930-438ab106313b tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] validate_networks() for [('ae35ad6c-d134-4864-852a-972a5c0cf360', None, None, None, None, None)] {{(pid=116362) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 14:25:14.193849 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-5b5602da-a9af-47e3-abb4-b7a4a8b5e427 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:14.214852 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-5b5602da-a9af-47e3-abb4-b7a4a8b5e427 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57" status: 200 len: 1318 microversion: 2.1 time: 0.309473 Feb 15 14:25:14.215871 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 77/152] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:13 2022] GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:14.348730 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-6f253c3f-1037-49cb-a609-136ae80c3c7f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:14.349606 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-6f253c3f-1037-49cb-a609-136ae80c3c7f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:14.356916 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6f253c3f-1037-49cb-a609-136ae80c3c7f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:14.357441 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6f253c3f-1037-49cb-a609-136ae80c3c7f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:14.358300 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6f253c3f-1037-49cb-a609-136ae80c3c7f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:14.359421 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6f253c3f-1037-49cb-a609-136ae80c3c7f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:14.519081 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-6f253c3f-1037-49cb-a609-136ae80c3c7f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:14.527844 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-6f253c3f-1037-49cb-a609-136ae80c3c7f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.182734 Feb 15 14:25:14.528686 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 78/153] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:14 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:14.576607 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-053c6380-a59e-4466-9930-438ab106313b tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Flavor limits 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 14:25:14.577191 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-053c6380-a59e-4466-9930-438ab106313b tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Image limits 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 14:25:14.578440 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-053c6380-a59e-4466-9930-438ab106313b tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Flavor pref 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 14:25:14.579496 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-053c6380-a59e-4466-9930-438ab106313b tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Image pref 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 14:25:14.579977 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-053c6380-a59e-4466-9930-438ab106313b tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 14:25:14.590891 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-053c6380-a59e-4466-9930-438ab106313b tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:14.591388 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-053c6380-a59e-4466-9930-438ab106313b tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:14.592493 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-053c6380-a59e-4466-9930-438ab106313b tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:14.593027 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-053c6380-a59e-4466-9930-438ab106313b tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:14.616240 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-053c6380-a59e-4466-9930-438ab106313b tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Getting quotas for project 8f2b25b171d84f23bca58cdb0eb675c6. Resources: {'instances', 'ram', 'cores'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:25:14.620196 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-053c6380-a59e-4466-9930-438ab106313b tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Getting quotas for user 23066575a3f64880a5106edf8004f737 and project 8f2b25b171d84f23bca58cdb0eb675c6. Resources: {'instances', 'ram', 'cores'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:25:14.634598 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-053c6380-a59e-4466-9930-438ab106313b tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Going to run 1 instances... {{(pid=116362) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 14:25:14.637424 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-053c6380-a59e-4466-9930-438ab106313b tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 14:25:14.690375 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-053c6380-a59e-4466-9930-438ab106313b tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.703272 Feb 15 14:25:14.691031 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 76/154] 10.222.0.83 () {60 vars in 1146 bytes} [Tue Feb 15 14:25:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 14:25:14.706098 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-3024aedc-fd18-4306-ab46-75022e545235 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:14.706692 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-3024aedc-fd18-4306-ab46-75022e545235 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:14.762248 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-3024aedc-fd18-4306-ab46-75022e545235 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:14.769826 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-3024aedc-fd18-4306-ab46-75022e545235 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1213 microversion: 2.1 time: 0.067822 Feb 15 14:25:14.770915 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 79/155] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:14 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:15.002976 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-4976eba5-7427-47b7-bb0d-e31ba94c451a tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:15.003512 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-4976eba5-7427-47b7-bb0d-e31ba94c451a tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:15.011128 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4976eba5-7427-47b7-bb0d-e31ba94c451a tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:15.011577 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4976eba5-7427-47b7-bb0d-e31ba94c451a tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:15.012428 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4976eba5-7427-47b7-bb0d-e31ba94c451a tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:15.012891 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4976eba5-7427-47b7-bb0d-e31ba94c451a tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:15.226236 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-4976eba5-7427-47b7-bb0d-e31ba94c451a tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:15.235288 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-dc876769-eea0-4e95-a23e-4ba0572d7db6 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:15.235967 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-dc876769-eea0-4e95-a23e-4ba0572d7db6 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:15.237959 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-4976eba5-7427-47b7-bb0d-e31ba94c451a tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1554 microversion: 2.1 time: 0.239731 Feb 15 14:25:15.239560 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 77/156] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:14 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1554 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:15.243977 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dc876769-eea0-4e95-a23e-4ba0572d7db6 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:15.247982 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dc876769-eea0-4e95-a23e-4ba0572d7db6 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:15.248873 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dc876769-eea0-4e95-a23e-4ba0572d7db6 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:15.250476 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dc876769-eea0-4e95-a23e-4ba0572d7db6 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:15.476326 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-dc876769-eea0-4e95-a23e-4ba0572d7db6 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:15.484318 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-dc876769-eea0-4e95-a23e-4ba0572d7db6 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57" status: 200 len: 1318 microversion: 2.1 time: 0.253494 Feb 15 14:25:15.485024 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 80/157] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:15 2022] GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:15.547609 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-ab242bf8-fd30-4783-b0dd-5f387042a96a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:15.548526 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-ab242bf8-fd30-4783-b0dd-5f387042a96a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:15.558604 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ab242bf8-fd30-4783-b0dd-5f387042a96a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:15.563611 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ab242bf8-fd30-4783-b0dd-5f387042a96a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:15.565315 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ab242bf8-fd30-4783-b0dd-5f387042a96a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:15.568998 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ab242bf8-fd30-4783-b0dd-5f387042a96a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:15.723373 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-ab242bf8-fd30-4783-b0dd-5f387042a96a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:15.730625 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-ab242bf8-fd30-4783-b0dd-5f387042a96a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.188222 Feb 15 14:25:15.731369 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 78/158] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:15 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:15.786642 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-f9b21ed3-a9b2-46d5-a265-fb8f1c2a9098 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:15.787339 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-f9b21ed3-a9b2-46d5-a265-fb8f1c2a9098 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:15.793634 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f9b21ed3-a9b2-46d5-a265-fb8f1c2a9098 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:15.794075 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f9b21ed3-a9b2-46d5-a265-fb8f1c2a9098 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:15.794839 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f9b21ed3-a9b2-46d5-a265-fb8f1c2a9098 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:15.795267 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f9b21ed3-a9b2-46d5-a265-fb8f1c2a9098 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:15.864079 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-f9b21ed3-a9b2-46d5-a265-fb8f1c2a9098 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:15.877901 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-f9b21ed3-a9b2-46d5-a265-fb8f1c2a9098 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1265 microversion: 2.1 time: 0.094845 Feb 15 14:25:15.879376 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 81/159] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:15 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1265 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:16.256202 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-dbd83129-d7db-4b08-8cf4-ae862f60aabb tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:16.257580 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-dbd83129-d7db-4b08-8cf4-ae862f60aabb tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:16.264593 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-dbd83129-d7db-4b08-8cf4-ae862f60aabb tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:16.265971 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-dbd83129-d7db-4b08-8cf4-ae862f60aabb tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:16.267030 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-dbd83129-d7db-4b08-8cf4-ae862f60aabb tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:16.267788 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-dbd83129-d7db-4b08-8cf4-ae862f60aabb tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:16.501906 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-c552b364-520f-4c44-9312-d0dabd9b2fc5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:16.502506 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-c552b364-520f-4c44-9312-d0dabd9b2fc5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:16.517889 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-dbd83129-d7db-4b08-8cf4-ae862f60aabb tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:16.526511 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-dbd83129-d7db-4b08-8cf4-ae862f60aabb tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1554 microversion: 2.1 time: 0.274668 Feb 15 14:25:16.528321 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c552b364-520f-4c44-9312-d0dabd9b2fc5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:16.529007 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c552b364-520f-4c44-9312-d0dabd9b2fc5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:16.530043 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c552b364-520f-4c44-9312-d0dabd9b2fc5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:16.532340 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c552b364-520f-4c44-9312-d0dabd9b2fc5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:16.536744 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 79/160] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:16 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1554 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:16.750162 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-aaf88038-ecde-4dc5-b7ed-b2b4983d04b9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:16.750890 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-aaf88038-ecde-4dc5-b7ed-b2b4983d04b9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:16.770697 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-aaf88038-ecde-4dc5-b7ed-b2b4983d04b9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:16.771092 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-aaf88038-ecde-4dc5-b7ed-b2b4983d04b9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:16.771851 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-aaf88038-ecde-4dc5-b7ed-b2b4983d04b9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:16.773422 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-aaf88038-ecde-4dc5-b7ed-b2b4983d04b9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:16.881890 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-c552b364-520f-4c44-9312-d0dabd9b2fc5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:16.894643 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-c552b364-520f-4c44-9312-d0dabd9b2fc5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57" status: 200 len: 1318 microversion: 2.1 time: 0.396533 Feb 15 14:25:16.895866 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 82/161] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:16 2022] GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57 => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:16.901391 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-b2dd8e02-d9f6-4003-936e-f713fbc2a64a tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:16.902268 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-b2dd8e02-d9f6-4003-936e-f713fbc2a64a tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:16.930655 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b2dd8e02-d9f6-4003-936e-f713fbc2a64a tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:16.931163 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b2dd8e02-d9f6-4003-936e-f713fbc2a64a tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:16.932018 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b2dd8e02-d9f6-4003-936e-f713fbc2a64a tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:16.932517 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b2dd8e02-d9f6-4003-936e-f713fbc2a64a tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:17.096029 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-b2dd8e02-d9f6-4003-936e-f713fbc2a64a tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:17.106534 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-b2dd8e02-d9f6-4003-936e-f713fbc2a64a tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1271 microversion: 2.1 time: 0.208265 Feb 15 14:25:17.107696 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 83/162] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:16 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1271 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:17.194647 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-aaf88038-ecde-4dc5-b7ed-b2b4983d04b9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:17.246077 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-aaf88038-ecde-4dc5-b7ed-b2b4983d04b9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.498801 Feb 15 14:25:17.254256 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 80/163] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:16 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:17.465156 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-bae2ea4d-d666-4db0-85f5-a527a4c55bcc req-fabcd8cf-84b4-4363-bad2-0af5b9667509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c5ab4c-5386-4e98-a890-434b75b6fa0f", "name": "network-vif-deleted", "tag": "9cc8b6d0-5c94-45c4-86e5-52e57da30c8f"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:25:17.467483 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:25:17.467483 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:25:17.482272 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-bae2ea4d-d666-4db0-85f5-a527a4c55bcc req-fabcd8cf-84b4-4363-bad2-0af5b9667509 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:17.482820 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-bae2ea4d-d666-4db0-85f5-a527a4c55bcc req-fabcd8cf-84b4-4363-bad2-0af5b9667509 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:17.519078 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-bae2ea4d-d666-4db0-85f5-a527a4c55bcc req-fabcd8cf-84b4-4363-bad2-0af5b9667509 service nova] Creating event network-vif-deleted:9cc8b6d0-5c94-45c4-86e5-52e57da30c8f for instance f5c5ab4c-5386-4e98-a890-434b75b6fa0f on hv-cinder-81914 Feb 15 14:25:17.527898 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-bae2ea4d-d666-4db0-85f5-a527a4c55bcc req-fabcd8cf-84b4-4363-bad2-0af5b9667509 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066329 Feb 15 14:25:17.532889 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 84/164] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:25:17.548803 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-24a4ede5-00cd-448c-bf4d-8acc54bb1271 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:17.549412 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-24a4ede5-00cd-448c-bf4d-8acc54bb1271 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:17.558815 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-24a4ede5-00cd-448c-bf4d-8acc54bb1271 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:17.562205 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-24a4ede5-00cd-448c-bf4d-8acc54bb1271 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:17.563202 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-24a4ede5-00cd-448c-bf4d-8acc54bb1271 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:17.564350 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-24a4ede5-00cd-448c-bf4d-8acc54bb1271 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:17.870509 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-24a4ede5-00cd-448c-bf4d-8acc54bb1271 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:17.880162 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-24a4ede5-00cd-448c-bf4d-8acc54bb1271 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1346 microversion: 2.1 time: 0.335620 Feb 15 14:25:17.891507 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 81/165] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:17 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1346 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:17.912548 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-01bd1316-0702-419a-869c-bf535a483b9c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:17.913740 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-01bd1316-0702-419a-869c-bf535a483b9c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:17.920371 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-01bd1316-0702-419a-869c-bf535a483b9c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:17.920907 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-01bd1316-0702-419a-869c-bf535a483b9c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:17.922401 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-01bd1316-0702-419a-869c-bf535a483b9c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:17.922834 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-01bd1316-0702-419a-869c-bf535a483b9c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:18.124532 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-4a487afa-b4ee-4f31-a885-895afbdd2215 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:18.125218 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-4a487afa-b4ee-4f31-a885-895afbdd2215 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:18.140914 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4a487afa-b4ee-4f31-a885-895afbdd2215 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:18.141781 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4a487afa-b4ee-4f31-a885-895afbdd2215 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:18.142828 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4a487afa-b4ee-4f31-a885-895afbdd2215 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:18.143415 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4a487afa-b4ee-4f31-a885-895afbdd2215 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:18.321608 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-01bd1316-0702-419a-869c-bf535a483b9c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:18.329606 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-01bd1316-0702-419a-869c-bf535a483b9c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57" status: 200 len: 1318 microversion: 2.1 time: 0.421597 Feb 15 14:25:18.330409 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 85/166] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:17 2022] GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57 => generated 1318 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:18.343295 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-844cbb2b-0658-4653-8615-ec6d55d7e55d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:18.344308 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-844cbb2b-0658-4653-8615-ec6d55d7e55d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:18.362310 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-844cbb2b-0658-4653-8615-ec6d55d7e55d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:18.362936 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-844cbb2b-0658-4653-8615-ec6d55d7e55d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:18.363825 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-844cbb2b-0658-4653-8615-ec6d55d7e55d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:18.364509 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-844cbb2b-0658-4653-8615-ec6d55d7e55d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:18.544090 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-4a487afa-b4ee-4f31-a885-895afbdd2215 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:18.559925 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-4a487afa-b4ee-4f31-a885-895afbdd2215 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1313 microversion: 2.1 time: 0.439522 Feb 15 14:25:18.560777 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 82/167] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:18 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:18.565527 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-01f981b3-8710-472a-8a5d-aa28e719069e req-39ea937e-fb10-42b9-8c7b-13037ae3093c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949b517a-36a2-4f77-bf15-8ed3c1cfaf57", "name": "network-vif-plugged", "status": "completed", "tag": "391f41ba-b06d-4edb-9881-4d4c52a864ad"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:25:18.567109 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:25:18.567109 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:25:18.574179 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-01f981b3-8710-472a-8a5d-aa28e719069e req-39ea937e-fb10-42b9-8c7b-13037ae3093c service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:18.574850 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-01f981b3-8710-472a-8a5d-aa28e719069e req-39ea937e-fb10-42b9-8c7b-13037ae3093c service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:18.578076 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-844cbb2b-0658-4653-8615-ec6d55d7e55d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:18.586561 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-844cbb2b-0658-4653-8615-ec6d55d7e55d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.254915 Feb 15 14:25:18.587695 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-01f981b3-8710-472a-8a5d-aa28e719069e req-39ea937e-fb10-42b9-8c7b-13037ae3093c service nova] Creating event network-vif-plugged:391f41ba-b06d-4edb-9881-4d4c52a864ad for instance 949b517a-36a2-4f77-bf15-8ed3c1cfaf57 on hv-cinder-81914 Feb 15 14:25:18.589373 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 86/168] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:18 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:18.603389 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-01f981b3-8710-472a-8a5d-aa28e719069e req-39ea937e-fb10-42b9-8c7b-13037ae3093c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041375 Feb 15 14:25:18.604205 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 83/169] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:25:18.905347 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-abbb4b25-8139-4608-b2d9-54780e74cad0 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:18.906000 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-abbb4b25-8139-4608-b2d9-54780e74cad0 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:18.929608 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-abbb4b25-8139-4608-b2d9-54780e74cad0 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:18.932543 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-abbb4b25-8139-4608-b2d9-54780e74cad0 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:18.933467 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-abbb4b25-8139-4608-b2d9-54780e74cad0 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:18.933917 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-abbb4b25-8139-4608-b2d9-54780e74cad0 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:19.008622 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-abbb4b25-8139-4608-b2d9-54780e74cad0 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:19.009709 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-abbb4b25-8139-4608-b2d9-54780e74cad0 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:19.010445 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.objects.instance [None req-abbb4b25-8139-4608-b2d9-54780e74cad0 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lazy-loading 'fault' on Instance uuid f5c5ab4c-5386-4e98-a890-434b75b6fa0f {{(pid=116363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:25:19.084203 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-abbb4b25-8139-4608-b2d9-54780e74cad0 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6049bcdd6941458f715d9678b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65b7a785c846f084db5bc9e8b70b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:19.109988 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-abbb4b25-8139-4608-b2d9-54780e74cad0 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 200 len: 1351 microversion: 2.1 time: 0.212408 Feb 15 14:25:19.111855 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 87/170] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:18 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 1351 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:19.138219 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-42721f70-e26e-4794-8c75-57d0c08f57d9 req-12b1b830-9f30-44cc-b18d-a73f18a9748a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088", "tag": "4a81fcd4-23cd-426b-ab57-b98a52ed554d"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:25:19.142645 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:25:19.142645 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:25:19.158473 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-42721f70-e26e-4794-8c75-57d0c08f57d9 req-12b1b830-9f30-44cc-b18d-a73f18a9748a service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:19.158918 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-42721f70-e26e-4794-8c75-57d0c08f57d9 req-12b1b830-9f30-44cc-b18d-a73f18a9748a service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:19.178488 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-42721f70-e26e-4794-8c75-57d0c08f57d9 req-12b1b830-9f30-44cc-b18d-a73f18a9748a service nova] Creating event network-changed:4a81fcd4-23cd-426b-ab57-b98a52ed554d for instance a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 on hv-cinder-81914 Feb 15 14:25:19.185800 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-42721f70-e26e-4794-8c75-57d0c08f57d9 req-12b1b830-9f30-44cc-b18d-a73f18a9748a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051509 Feb 15 14:25:19.188761 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 84/171] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:25:19.346715 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-3c03cb20-78fa-4943-83b5-7ba65cda16c5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:19.347425 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-3c03cb20-78fa-4943-83b5-7ba65cda16c5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:19.356714 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3c03cb20-78fa-4943-83b5-7ba65cda16c5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:19.357172 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3c03cb20-78fa-4943-83b5-7ba65cda16c5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:19.357966 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3c03cb20-78fa-4943-83b5-7ba65cda16c5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:19.358499 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3c03cb20-78fa-4943-83b5-7ba65cda16c5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:19.518590 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-3c03cb20-78fa-4943-83b5-7ba65cda16c5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:19.526712 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-3c03cb20-78fa-4943-83b5-7ba65cda16c5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57" status: 200 len: 1318 microversion: 2.1 time: 0.183827 Feb 15 14:25:19.527282 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 88/172] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:19 2022] GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:19.580595 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-e1aa4df2-5088-47d5-bdc9-68796a5e30f0 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:19.581310 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-e1aa4df2-5088-47d5-bdc9-68796a5e30f0 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:19.587662 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e1aa4df2-5088-47d5-bdc9-68796a5e30f0 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:19.588103 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e1aa4df2-5088-47d5-bdc9-68796a5e30f0 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:19.588895 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e1aa4df2-5088-47d5-bdc9-68796a5e30f0 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:19.589327 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e1aa4df2-5088-47d5-bdc9-68796a5e30f0 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:19.607554 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-7fd3bd89-6ae6-4f19-bef8-01b4d4184720 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:19.608185 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-7fd3bd89-6ae6-4f19-bef8-01b4d4184720 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:19.615305 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7fd3bd89-6ae6-4f19-bef8-01b4d4184720 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:19.615758 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7fd3bd89-6ae6-4f19-bef8-01b4d4184720 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:19.616583 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7fd3bd89-6ae6-4f19-bef8-01b4d4184720 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:19.617163 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7fd3bd89-6ae6-4f19-bef8-01b4d4184720 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:19.746083 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-e1aa4df2-5088-47d5-bdc9-68796a5e30f0 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:19.755838 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-e1aa4df2-5088-47d5-bdc9-68796a5e30f0 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1313 microversion: 2.1 time: 0.182329 Feb 15 14:25:19.756439 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 85/173] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:19 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:19.775320 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-7fd3bd89-6ae6-4f19-bef8-01b4d4184720 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:19.783218 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-7fd3bd89-6ae6-4f19-bef8-01b4d4184720 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.179437 Feb 15 14:25:19.783802 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 89/174] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:19 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:20.127001 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-833dc0a7-50d2-474a-8fa4-ce0d1d6748f1 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:20.127610 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-833dc0a7-50d2-474a-8fa4-ce0d1d6748f1 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:20.133664 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-833dc0a7-50d2-474a-8fa4-ce0d1d6748f1 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:20.134117 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-833dc0a7-50d2-474a-8fa4-ce0d1d6748f1 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:20.134890 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-833dc0a7-50d2-474a-8fa4-ce0d1d6748f1 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:20.135323 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-833dc0a7-50d2-474a-8fa4-ce0d1d6748f1 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:20.148957 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.wsgi [None req-833dc0a7-50d2-474a-8fa4-ce0d1d6748f1 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] HTTP exception thrown: Instance f5c5ab4c-5386-4e98-a890-434b75b6fa0f could not be found. Feb 15 14:25:20.149582 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-833dc0a7-50d2-474a-8fa4-ce0d1d6748f1 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Returning 404 to user: Instance f5c5ab4c-5386-4e98-a890-434b75b6fa0f could not be found. {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:25:20.150474 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-833dc0a7-50d2-474a-8fa4-ce0d1d6748f1 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 404 len: 111 microversion: 2.1 time: 0.027321 Feb 15 14:25:20.151050 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 86/175] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:20 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:25:20.249936 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-05320b81-7462-451d-bf72-921259ae89e2 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:20.250833 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-05320b81-7462-451d-bf72-921259ae89e2 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:20.256707 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-05320b81-7462-451d-bf72-921259ae89e2 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:20.257150 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-05320b81-7462-451d-bf72-921259ae89e2 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:20.257939 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-05320b81-7462-451d-bf72-921259ae89e2 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:20.258366 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-05320b81-7462-451d-bf72-921259ae89e2 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:20.270637 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.wsgi [None req-05320b81-7462-451d-bf72-921259ae89e2 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] HTTP exception thrown: Instance f5c5ab4c-5386-4e98-a890-434b75b6fa0f could not be found. Feb 15 14:25:20.271441 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-05320b81-7462-451d-bf72-921259ae89e2 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Returning 404 to user: Instance f5c5ab4c-5386-4e98-a890-434b75b6fa0f could not be found. {{(pid=116363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:25:20.272263 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-05320b81-7462-451d-bf72-921259ae89e2 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.026257 Feb 15 14:25:20.273028 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 90/176] 10.222.0.83 () {58 vars in 1301 bytes} [Tue Feb 15 14:25:20 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f/os-volume_attachments => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:25:20.542931 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-d4c07755-6bb1-43f7-883b-7bc691b99095 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:20.543475 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-d4c07755-6bb1-43f7-883b-7bc691b99095 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:20.549868 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d4c07755-6bb1-43f7-883b-7bc691b99095 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:20.550317 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d4c07755-6bb1-43f7-883b-7bc691b99095 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:20.551086 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d4c07755-6bb1-43f7-883b-7bc691b99095 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:20.551523 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d4c07755-6bb1-43f7-883b-7bc691b99095 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:20.680093 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-d4c07755-6bb1-43f7-883b-7bc691b99095 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:20.687979 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-d4c07755-6bb1-43f7-883b-7bc691b99095 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57" status: 200 len: 1318 microversion: 2.1 time: 0.148701 Feb 15 14:25:20.688567 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 87/177] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:20 2022] GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:20.774751 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-c3f3405a-de24-4db9-85e9-64d720f53dcb tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:20.775495 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-c3f3405a-de24-4db9-85e9-64d720f53dcb tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:20.782524 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c3f3405a-de24-4db9-85e9-64d720f53dcb tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:20.782950 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c3f3405a-de24-4db9-85e9-64d720f53dcb tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:20.783713 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c3f3405a-de24-4db9-85e9-64d720f53dcb tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:20.784145 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c3f3405a-de24-4db9-85e9-64d720f53dcb tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:20.804625 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-0bc9fd0d-a01e-4c4f-bb91-ef2a044457f5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:20.805189 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-0bc9fd0d-a01e-4c4f-bb91-ef2a044457f5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:20.810978 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0bc9fd0d-a01e-4c4f-bb91-ef2a044457f5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:20.811436 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0bc9fd0d-a01e-4c4f-bb91-ef2a044457f5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:20.812216 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0bc9fd0d-a01e-4c4f-bb91-ef2a044457f5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:20.812699 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0bc9fd0d-a01e-4c4f-bb91-ef2a044457f5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:20.918021 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-c3f3405a-de24-4db9-85e9-64d720f53dcb tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:20.926079 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-c3f3405a-de24-4db9-85e9-64d720f53dcb tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1313 microversion: 2.1 time: 0.156359 Feb 15 14:25:20.926648 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 91/178] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:20 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:20.947845 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-0bc9fd0d-a01e-4c4f-bb91-ef2a044457f5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:20.955761 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-0bc9fd0d-a01e-4c4f-bb91-ef2a044457f5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.154806 Feb 15 14:25:20.956323 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 88/179] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:20 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:21.705491 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-116fb390-f57d-418b-884c-fdf20fe7f65a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:21.706098 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-116fb390-f57d-418b-884c-fdf20fe7f65a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:21.711952 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-116fb390-f57d-418b-884c-fdf20fe7f65a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:21.712537 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-116fb390-f57d-418b-884c-fdf20fe7f65a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:21.713446 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-116fb390-f57d-418b-884c-fdf20fe7f65a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:21.713871 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-116fb390-f57d-418b-884c-fdf20fe7f65a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:21.847045 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-116fb390-f57d-418b-884c-fdf20fe7f65a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:21.854226 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-116fb390-f57d-418b-884c-fdf20fe7f65a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57" status: 200 len: 1318 microversion: 2.1 time: 0.153418 Feb 15 14:25:21.854787 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 92/180] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:21 2022] GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:21.943062 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-72376c65-f723-4c3d-8699-d3215dedac53 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:21.943673 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-72376c65-f723-4c3d-8699-d3215dedac53 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:21.949605 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-72376c65-f723-4c3d-8699-d3215dedac53 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:21.950055 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-72376c65-f723-4c3d-8699-d3215dedac53 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:21.950827 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-72376c65-f723-4c3d-8699-d3215dedac53 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:21.951265 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-72376c65-f723-4c3d-8699-d3215dedac53 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:21.972233 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-8c188e07-59e4-4bd4-94d3-00658a4aa30b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:21.972870 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-8c188e07-59e4-4bd4-94d3-00658a4aa30b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:21.978602 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8c188e07-59e4-4bd4-94d3-00658a4aa30b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:21.979043 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8c188e07-59e4-4bd4-94d3-00658a4aa30b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:21.979804 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8c188e07-59e4-4bd4-94d3-00658a4aa30b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:21.980234 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8c188e07-59e4-4bd4-94d3-00658a4aa30b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:22.090709 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-72376c65-f723-4c3d-8699-d3215dedac53 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:22.098470 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-72376c65-f723-4c3d-8699-d3215dedac53 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1313 microversion: 2.1 time: 0.159074 Feb 15 14:25:22.099061 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 89/181] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:21 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:22.114674 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-8c188e07-59e4-4bd4-94d3-00658a4aa30b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:22.121966 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-8c188e07-59e4-4bd4-94d3-00658a4aa30b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.153338 Feb 15 14:25:22.122531 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 93/182] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:21 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:22.870657 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-7927f06c-8f90-4f8a-8344-c485dc3ba734 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:22.871573 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-7927f06c-8f90-4f8a-8344-c485dc3ba734 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:22.878337 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7927f06c-8f90-4f8a-8344-c485dc3ba734 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:22.879305 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7927f06c-8f90-4f8a-8344-c485dc3ba734 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:22.880515 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7927f06c-8f90-4f8a-8344-c485dc3ba734 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:22.881013 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7927f06c-8f90-4f8a-8344-c485dc3ba734 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:23.116025 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-9799e2db-89a6-481b-87a6-6ff6f3f5d343 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:23.117040 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-9799e2db-89a6-481b-87a6-6ff6f3f5d343 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:23.124842 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9799e2db-89a6-481b-87a6-6ff6f3f5d343 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:23.125437 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9799e2db-89a6-481b-87a6-6ff6f3f5d343 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:23.126550 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9799e2db-89a6-481b-87a6-6ff6f3f5d343 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:23.127168 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9799e2db-89a6-481b-87a6-6ff6f3f5d343 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:23.148743 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-7927f06c-8f90-4f8a-8344-c485dc3ba734 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:23.160343 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-7927f06c-8f90-4f8a-8344-c485dc3ba734 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57" status: 200 len: 1318 microversion: 2.1 time: 0.293136 Feb 15 14:25:23.161451 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 90/183] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:22 2022] GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:23.166421 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-b448f441-3030-4b51-9a4a-3b2ee535f4e5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:23.167203 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-b448f441-3030-4b51-9a4a-3b2ee535f4e5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:23.198293 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b448f441-3030-4b51-9a4a-3b2ee535f4e5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:23.198748 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b448f441-3030-4b51-9a4a-3b2ee535f4e5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:23.199546 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b448f441-3030-4b51-9a4a-3b2ee535f4e5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:23.199980 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b448f441-3030-4b51-9a4a-3b2ee535f4e5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:23.295899 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-9799e2db-89a6-481b-87a6-6ff6f3f5d343 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:23.306004 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-9799e2db-89a6-481b-87a6-6ff6f3f5d343 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1313 microversion: 2.1 time: 0.194452 Feb 15 14:25:23.306795 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 94/184] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:23 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:23.471055 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-b448f441-3030-4b51-9a4a-3b2ee535f4e5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:23.492247 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-b448f441-3030-4b51-9a4a-3b2ee535f4e5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.329449 Feb 15 14:25:23.502433 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 91/185] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:23 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:23.560594 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-578e14d4-e0eb-431f-95ee-35930eca0c5f tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:23.561659 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-578e14d4-e0eb-431f-95ee-35930eca0c5f tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:23.571154 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-578e14d4-e0eb-431f-95ee-35930eca0c5f tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:23.571729 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-578e14d4-e0eb-431f-95ee-35930eca0c5f tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:23.576761 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-578e14d4-e0eb-431f-95ee-35930eca0c5f tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:23.576761 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-578e14d4-e0eb-431f-95ee-35930eca0c5f tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:23.595712 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.wsgi [None req-578e14d4-e0eb-431f-95ee-35930eca0c5f tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] HTTP exception thrown: Instance f5c5ab4c-5386-4e98-a890-434b75b6fa0f could not be found. Feb 15 14:25:23.596430 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-578e14d4-e0eb-431f-95ee-35930eca0c5f tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Returning 404 to user: Instance f5c5ab4c-5386-4e98-a890-434b75b6fa0f could not be found. {{(pid=116363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:25:23.598082 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-578e14d4-e0eb-431f-95ee-35930eca0c5f tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "DELETE /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 404 len: 111 microversion: 2.1 time: 0.042280 Feb 15 14:25:23.599042 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 95/186] 10.222.0.83 () {58 vars in 1238 bytes} [Tue Feb 15 14:25:23 2022] DELETE /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:25:23.609251 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-645983f2-f744-4dec-8fda-74bbda071ea4 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:23.610519 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-645983f2-f744-4dec-8fda-74bbda071ea4 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] [instance: f5c5ab4c-5386-4e98-a890-434b75b6fa0f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:23.619089 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-645983f2-f744-4dec-8fda-74bbda071ea4 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:23.619558 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-645983f2-f744-4dec-8fda-74bbda071ea4 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:23.620420 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-645983f2-f744-4dec-8fda-74bbda071ea4 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:23.622231 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-645983f2-f744-4dec-8fda-74bbda071ea4 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:23.638682 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.wsgi [None req-645983f2-f744-4dec-8fda-74bbda071ea4 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] HTTP exception thrown: Instance f5c5ab4c-5386-4e98-a890-434b75b6fa0f could not be found. Feb 15 14:25:23.638815 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-645983f2-f744-4dec-8fda-74bbda071ea4 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] Returning 404 to user: Instance f5c5ab4c-5386-4e98-a890-434b75b6fa0f could not be found. {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:25:23.640304 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-645983f2-f744-4dec-8fda-74bbda071ea4 tempest-DeleteServersTestJSON-612834103 tempest-DeleteServersTestJSON-612834103-project] 10.222.0.83 "GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f" status: 404 len: 111 microversion: 2.1 time: 0.036059 Feb 15 14:25:23.641292 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 92/187] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:23 2022] GET /compute/v2.1/servers/f5c5ab4c-5386-4e98-a890-434b75b6fa0f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:25:24.177206 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-9783364b-5165-477a-aac7-64825cc91d91 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:24.178767 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-9783364b-5165-477a-aac7-64825cc91d91 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:24.187507 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9783364b-5165-477a-aac7-64825cc91d91 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:24.188818 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9783364b-5165-477a-aac7-64825cc91d91 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:24.189609 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9783364b-5165-477a-aac7-64825cc91d91 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:24.190013 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9783364b-5165-477a-aac7-64825cc91d91 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:24.324496 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-464179a2-3633-42dc-8c00-3b0e01ebdb76 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:24.324999 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-464179a2-3633-42dc-8c00-3b0e01ebdb76 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:24.332712 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-464179a2-3633-42dc-8c00-3b0e01ebdb76 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:24.333516 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-464179a2-3633-42dc-8c00-3b0e01ebdb76 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:24.335345 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-464179a2-3633-42dc-8c00-3b0e01ebdb76 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:24.336058 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-464179a2-3633-42dc-8c00-3b0e01ebdb76 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:24.398353 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-9783364b-5165-477a-aac7-64825cc91d91 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:24.408491 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-9783364b-5165-477a-aac7-64825cc91d91 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57" status: 200 len: 1318 microversion: 2.1 time: 0.234998 Feb 15 14:25:24.409737 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 96/188] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:24 2022] GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:24.513551 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-20352d4e-86ef-4cfa-a8b9-a5e51e4844d4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:24.514774 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-20352d4e-86ef-4cfa-a8b9-a5e51e4844d4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:24.523222 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-20352d4e-86ef-4cfa-a8b9-a5e51e4844d4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:24.524047 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-20352d4e-86ef-4cfa-a8b9-a5e51e4844d4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:24.525868 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-20352d4e-86ef-4cfa-a8b9-a5e51e4844d4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:24.526549 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-20352d4e-86ef-4cfa-a8b9-a5e51e4844d4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:24.555762 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-464179a2-3633-42dc-8c00-3b0e01ebdb76 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:24.564100 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-464179a2-3633-42dc-8c00-3b0e01ebdb76 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1313 microversion: 2.1 time: 0.244500 Feb 15 14:25:24.565071 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 93/189] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:24 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:24.952934 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-20352d4e-86ef-4cfa-a8b9-a5e51e4844d4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:24.962824 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-20352d4e-86ef-4cfa-a8b9-a5e51e4844d4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.456576 Feb 15 14:25:24.963399 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 97/190] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:24 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:25.426429 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-a10cb351-9f8f-4c55-bdae-18f7337858c1 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:25.427062 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-a10cb351-9f8f-4c55-bdae-18f7337858c1 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:25.434191 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a10cb351-9f8f-4c55-bdae-18f7337858c1 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:25.434974 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a10cb351-9f8f-4c55-bdae-18f7337858c1 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:25.436286 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a10cb351-9f8f-4c55-bdae-18f7337858c1 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:25.437137 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a10cb351-9f8f-4c55-bdae-18f7337858c1 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:25.582017 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-1c60c731-2b07-4ae3-9a7c-5d72f6c6d573 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:25.582653 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-1c60c731-2b07-4ae3-9a7c-5d72f6c6d573 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:25.590451 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1c60c731-2b07-4ae3-9a7c-5d72f6c6d573 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:25.591186 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1c60c731-2b07-4ae3-9a7c-5d72f6c6d573 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:25.592200 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1c60c731-2b07-4ae3-9a7c-5d72f6c6d573 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:25.593632 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1c60c731-2b07-4ae3-9a7c-5d72f6c6d573 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:25.612750 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-a10cb351-9f8f-4c55-bdae-18f7337858c1 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:25.627104 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-a10cb351-9f8f-4c55-bdae-18f7337858c1 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57" status: 200 len: 1508 microversion: 2.1 time: 0.204342 Feb 15 14:25:25.628049 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 94/191] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:25 2022] GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57 => generated 1508 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:25.644827 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-41d18795-de44-4990-a550-8d57eaf18e7d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "874ebbec-7220-4a48-b013-103ae6fc6f01"}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:25:25.646340 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-41d18795-de44-4990-a550-8d57eaf18e7d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:25.653134 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-41d18795-de44-4990-a550-8d57eaf18e7d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:25.653590 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-41d18795-de44-4990-a550-8d57eaf18e7d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:25.654828 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-41d18795-de44-4990-a550-8d57eaf18e7d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:25.654828 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-41d18795-de44-4990-a550-8d57eaf18e7d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:25.758323 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.wsgi [None req-41d18795-de44-4990-a550-8d57eaf18e7d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] HTTP exception thrown: Invalid volume: volume 874ebbec-7220-4a48-b013-103ae6fc6f01 is already attached to instances: 2d6c38be-13a5-4c57-badb-c4371acfb34c Feb 15 14:25:25.758949 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-41d18795-de44-4990-a550-8d57eaf18e7d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Returning 400 to user: Invalid volume: volume 874ebbec-7220-4a48-b013-103ae6fc6f01 is already attached to instances: 2d6c38be-13a5-4c57-badb-c4371acfb34c {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:25:25.759786 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-1c60c731-2b07-4ae3-9a7c-5d72f6c6d573 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:25.760299 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-41d18795-de44-4990-a550-8d57eaf18e7d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "POST /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.119495 Feb 15 14:25:25.760963 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 95/192] 10.222.0.83 () {60 vars in 1322 bytes} [Tue Feb 15 14:25:25 2022] POST /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57/os-volume_attachments => generated 174 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 15 14:25:25.769180 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-1c60c731-2b07-4ae3-9a7c-5d72f6c6d573 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1313 microversion: 2.1 time: 0.191358 Feb 15 14:25:25.770526 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 98/193] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:25 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:25.823420 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-d28ba6e1-15b7-427c-ad3c-ccd3f2699b7a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:25.823995 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-d28ba6e1-15b7-427c-ad3c-ccd3f2699b7a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:25.831585 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d28ba6e1-15b7-427c-ad3c-ccd3f2699b7a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:25.832037 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d28ba6e1-15b7-427c-ad3c-ccd3f2699b7a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:25.833030 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d28ba6e1-15b7-427c-ad3c-ccd3f2699b7a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:25.833466 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d28ba6e1-15b7-427c-ad3c-ccd3f2699b7a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:25.971910 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.objects.instance [None req-d28ba6e1-15b7-427c-ad3c-ccd3f2699b7a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lazy-loading 'services' on Instance uuid 2d6c38be-13a5-4c57-badb-c4371acfb34c {{(pid=116362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:25:25.984068 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-259199a0-678c-44b2-bca8-001c343e032f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:25.984713 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-259199a0-678c-44b2-bca8-001c343e032f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:25.991380 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-259199a0-678c-44b2-bca8-001c343e032f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:25.992008 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-259199a0-678c-44b2-bca8-001c343e032f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:25.992979 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-259199a0-678c-44b2-bca8-001c343e032f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:25.993658 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-259199a0-678c-44b2-bca8-001c343e032f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:26.118696 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-d28ba6e1-15b7-427c-ad3c-ccd3f2699b7a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "DELETE /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c/os-volume_attachments/874ebbec-7220-4a48-b013-103ae6fc6f01" status: 202 len: 0 microversion: 2.1 time: 0.298804 Feb 15 14:25:26.119561 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 96/194] 10.222.0.83 () {58 vars in 1415 bytes} [Tue Feb 15 14:25:25 2022] DELETE /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c/os-volume_attachments/874ebbec-7220-4a48-b013-103ae6fc6f01 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:25:26.129641 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-ef27592d-256a-46df-8b78-2ed22c9c851d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:26.131066 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-ef27592d-256a-46df-8b78-2ed22c9c851d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:26.139203 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ef27592d-256a-46df-8b78-2ed22c9c851d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:26.139941 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ef27592d-256a-46df-8b78-2ed22c9c851d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:26.140973 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ef27592d-256a-46df-8b78-2ed22c9c851d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:26.141556 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ef27592d-256a-46df-8b78-2ed22c9c851d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:26.191212 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-ef27592d-256a-46df-8b78-2ed22c9c851d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065360 Feb 15 14:25:26.195610 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 97/195] 10.222.0.83 () {58 vars in 1301 bytes} [Tue Feb 15 14:25:26 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:25:26.218269 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-259199a0-678c-44b2-bca8-001c343e032f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:26.227464 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-259199a0-678c-44b2-bca8-001c343e032f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.250103 Feb 15 14:25:26.228166 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 99/196] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:25 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:26.788704 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-5b1485fd-1bbb-4d7c-bbfe-0caa88f86611 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:26.790053 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-5b1485fd-1bbb-4d7c-bbfe-0caa88f86611 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:26.798026 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5b1485fd-1bbb-4d7c-bbfe-0caa88f86611 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:26.798760 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5b1485fd-1bbb-4d7c-bbfe-0caa88f86611 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:26.800606 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5b1485fd-1bbb-4d7c-bbfe-0caa88f86611 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:26.801284 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5b1485fd-1bbb-4d7c-bbfe-0caa88f86611 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:27.005504 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-5b1485fd-1bbb-4d7c-bbfe-0caa88f86611 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:27.013134 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-5b1485fd-1bbb-4d7c-bbfe-0caa88f86611 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1313 microversion: 2.1 time: 0.229342 Feb 15 14:25:27.013968 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 98/197] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:26 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:27.205249 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-ebffded0-aa42-4ae4-984d-dcb2bebe1519 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:27.206238 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-ebffded0-aa42-4ae4-984d-dcb2bebe1519 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:27.213187 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ebffded0-aa42-4ae4-984d-dcb2bebe1519 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:27.213894 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ebffded0-aa42-4ae4-984d-dcb2bebe1519 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:27.214971 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ebffded0-aa42-4ae4-984d-dcb2bebe1519 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:27.215385 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ebffded0-aa42-4ae4-984d-dcb2bebe1519 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:27.244592 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-cbec6498-1226-417a-9f8d-44c96e741d7e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:27.245690 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-cbec6498-1226-417a-9f8d-44c96e741d7e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:27.248894 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-ebffded0-aa42-4ae4-984d-dcb2bebe1519 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048869 Feb 15 14:25:27.249243 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 100/198] 10.222.0.83 () {58 vars in 1301 bytes} [Tue Feb 15 14:25:27 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:25:27.254376 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cbec6498-1226-417a-9f8d-44c96e741d7e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:27.254898 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cbec6498-1226-417a-9f8d-44c96e741d7e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:27.255779 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cbec6498-1226-417a-9f8d-44c96e741d7e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:27.256281 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cbec6498-1226-417a-9f8d-44c96e741d7e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:27.395342 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-cbec6498-1226-417a-9f8d-44c96e741d7e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:27.403137 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-cbec6498-1226-417a-9f8d-44c96e741d7e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.162289 Feb 15 14:25:27.403788 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 99/199] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:27 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:28.031000 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-561ed209-b0dc-4c0e-85ea-a48a94c40699 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:28.031602 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-561ed209-b0dc-4c0e-85ea-a48a94c40699 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:28.038020 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-561ed209-b0dc-4c0e-85ea-a48a94c40699 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:28.038460 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-561ed209-b0dc-4c0e-85ea-a48a94c40699 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:28.039232 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-561ed209-b0dc-4c0e-85ea-a48a94c40699 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:28.039758 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-561ed209-b0dc-4c0e-85ea-a48a94c40699 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:28.195439 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-561ed209-b0dc-4c0e-85ea-a48a94c40699 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:28.203510 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-561ed209-b0dc-4c0e-85ea-a48a94c40699 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1313 microversion: 2.1 time: 0.176445 Feb 15 14:25:28.204093 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 101/200] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:28 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:28.260320 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-c61eaaef-d402-4c5e-b5d8-a15e8a3311dd tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:28.261360 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-c61eaaef-d402-4c5e-b5d8-a15e8a3311dd tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:28.271136 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c61eaaef-d402-4c5e-b5d8-a15e8a3311dd tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:28.271673 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c61eaaef-d402-4c5e-b5d8-a15e8a3311dd tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:28.272373 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c61eaaef-d402-4c5e-b5d8-a15e8a3311dd tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:28.272836 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c61eaaef-d402-4c5e-b5d8-a15e8a3311dd tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:28.302994 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-c61eaaef-d402-4c5e-b5d8-a15e8a3311dd tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046439 Feb 15 14:25:28.308279 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 100/201] 10.222.0.83 () {58 vars in 1301 bytes} [Tue Feb 15 14:25:28 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 14:25:28.422181 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-e212f26b-0551-476a-89e1-7bf35015b8f0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:28.423370 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-e212f26b-0551-476a-89e1-7bf35015b8f0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:28.430179 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e212f26b-0551-476a-89e1-7bf35015b8f0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:28.430692 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e212f26b-0551-476a-89e1-7bf35015b8f0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:28.431484 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e212f26b-0551-476a-89e1-7bf35015b8f0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:28.431920 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e212f26b-0551-476a-89e1-7bf35015b8f0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:28.493018 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-63415802-bc56-42d8-9e82-19aa9a77c3e5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-393394493", "imageRef": "da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53", "flavorRef": "452", "networks": [{"uuid": "eff5572c-5ad3-47ef-8854-8018b7c6065d"}]}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:25:28.549477 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.network.neutron [None req-63415802-bc56-42d8-9e82-19aa9a77c3e5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] validate_networks() for [('eff5572c-5ad3-47ef-8854-8018b7c6065d', None, None, None, None, None)] {{(pid=116362) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 14:25:28.599285 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-e212f26b-0551-476a-89e1-7bf35015b8f0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:28.607704 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-e212f26b-0551-476a-89e1-7bf35015b8f0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.189191 Feb 15 14:25:28.608935 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 102/202] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:28 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:29.103725 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-63415802-bc56-42d8-9e82-19aa9a77c3e5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Flavor limits 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 14:25:29.104149 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-63415802-bc56-42d8-9e82-19aa9a77c3e5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Image limits 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 14:25:29.104656 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-63415802-bc56-42d8-9e82-19aa9a77c3e5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Flavor pref 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 14:25:29.105067 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-63415802-bc56-42d8-9e82-19aa9a77c3e5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Image pref 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 14:25:29.105476 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-63415802-bc56-42d8-9e82-19aa9a77c3e5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 14:25:29.114267 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-63415802-bc56-42d8-9e82-19aa9a77c3e5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:29.114721 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-63415802-bc56-42d8-9e82-19aa9a77c3e5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:29.115629 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-63415802-bc56-42d8-9e82-19aa9a77c3e5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:29.116381 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-63415802-bc56-42d8-9e82-19aa9a77c3e5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:29.135328 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-63415802-bc56-42d8-9e82-19aa9a77c3e5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Getting quotas for project b003f1ecbf4e4a32a99159d5b18a98ec. Resources: {'instances', 'ram', 'cores'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:25:29.140440 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-63415802-bc56-42d8-9e82-19aa9a77c3e5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Getting quotas for user 9b50593d13054c9c8fdf463566f36b2e and project b003f1ecbf4e4a32a99159d5b18a98ec. Resources: {'instances', 'ram', 'cores'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:25:29.152148 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-63415802-bc56-42d8-9e82-19aa9a77c3e5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Going to run 1 instances... {{(pid=116362) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 14:25:29.154610 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-63415802-bc56-42d8-9e82-19aa9a77c3e5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 14:25:29.201502 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-63415802-bc56-42d8-9e82-19aa9a77c3e5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.712172 Feb 15 14:25:29.202344 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 101/203] 10.222.0.83 () {60 vars in 1146 bytes} [Tue Feb 15 14:25:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 15 14:25:29.213028 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-8f403963-6e8d-417d-a315-0a5599f96bce tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:29.213377 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-8f403963-6e8d-417d-a315-0a5599f96bce tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:29.222090 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-94893dbf-bdfd-482b-a2e1-3bd71846459e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:29.223506 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-94893dbf-bdfd-482b-a2e1-3bd71846459e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:29.231730 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-94893dbf-bdfd-482b-a2e1-3bd71846459e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:29.232182 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-94893dbf-bdfd-482b-a2e1-3bd71846459e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:29.233605 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-94893dbf-bdfd-482b-a2e1-3bd71846459e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:29.234372 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-94893dbf-bdfd-482b-a2e1-3bd71846459e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:29.275783 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-8f403963-6e8d-417d-a315-0a5599f96bce tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:29.284979 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-8f403963-6e8d-417d-a315-0a5599f96bce tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 200 len: 1217 microversion: 2.1 time: 0.076071 Feb 15 14:25:29.285729 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 103/204] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:29 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 1217 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:29.410567 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-94893dbf-bdfd-482b-a2e1-3bd71846459e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:29.418036 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-94893dbf-bdfd-482b-a2e1-3bd71846459e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1313 microversion: 2.1 time: 0.200521 Feb 15 14:25:29.418783 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 102/205] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:29 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:29.625111 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-d0e28095-a806-4dba-b6ea-7b3ace81fbc8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:29.625842 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-d0e28095-a806-4dba-b6ea-7b3ace81fbc8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:29.632287 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d0e28095-a806-4dba-b6ea-7b3ace81fbc8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:29.632764 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d0e28095-a806-4dba-b6ea-7b3ace81fbc8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:29.633587 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d0e28095-a806-4dba-b6ea-7b3ace81fbc8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:29.633997 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d0e28095-a806-4dba-b6ea-7b3ace81fbc8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:29.769668 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-d0e28095-a806-4dba-b6ea-7b3ace81fbc8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:29.778715 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-d0e28095-a806-4dba-b6ea-7b3ace81fbc8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.157354 Feb 15 14:25:29.779299 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 104/206] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:29 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:30.302529 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-46f09599-5ff7-46ea-a595-f324a1610804 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:30.303091 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-46f09599-5ff7-46ea-a595-f324a1610804 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:30.309128 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-46f09599-5ff7-46ea-a595-f324a1610804 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:30.309579 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-46f09599-5ff7-46ea-a595-f324a1610804 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:30.310356 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-46f09599-5ff7-46ea-a595-f324a1610804 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:30.310788 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-46f09599-5ff7-46ea-a595-f324a1610804 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:30.374004 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-46f09599-5ff7-46ea-a595-f324a1610804 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:30.381411 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-46f09599-5ff7-46ea-a595-f324a1610804 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 200 len: 1221 microversion: 2.1 time: 0.082669 Feb 15 14:25:30.381993 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 103/207] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:30 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 1221 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:30.438956 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-5cde6171-d2d4-4589-9dc3-54335ad60555 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:30.439554 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-5cde6171-d2d4-4589-9dc3-54335ad60555 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:30.445726 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5cde6171-d2d4-4589-9dc3-54335ad60555 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:30.446168 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5cde6171-d2d4-4589-9dc3-54335ad60555 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:30.446922 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5cde6171-d2d4-4589-9dc3-54335ad60555 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:30.447349 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5cde6171-d2d4-4589-9dc3-54335ad60555 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:30.576587 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-5cde6171-d2d4-4589-9dc3-54335ad60555 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:30.584256 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-5cde6171-d2d4-4589-9dc3-54335ad60555 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1313 microversion: 2.1 time: 0.149137 Feb 15 14:25:30.584848 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 105/208] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:30 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:30.796978 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-73e7fa70-c479-4fbf-8328-fc1d2ad12583 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:30.797572 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-73e7fa70-c479-4fbf-8328-fc1d2ad12583 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:30.803389 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-73e7fa70-c479-4fbf-8328-fc1d2ad12583 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:30.803951 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-73e7fa70-c479-4fbf-8328-fc1d2ad12583 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:30.804657 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-73e7fa70-c479-4fbf-8328-fc1d2ad12583 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:30.805091 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-73e7fa70-c479-4fbf-8328-fc1d2ad12583 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:30.947835 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-73e7fa70-c479-4fbf-8328-fc1d2ad12583 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:30.956037 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-73e7fa70-c479-4fbf-8328-fc1d2ad12583 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.163198 Feb 15 14:25:30.956651 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 104/209] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:30 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:31.398510 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-76e4eb89-7538-4fc5-8973-2dafe6652df9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:31.399113 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-76e4eb89-7538-4fc5-8973-2dafe6652df9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:31.405598 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-76e4eb89-7538-4fc5-8973-2dafe6652df9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:31.406240 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-76e4eb89-7538-4fc5-8973-2dafe6652df9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:31.407077 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-76e4eb89-7538-4fc5-8973-2dafe6652df9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:31.407516 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-76e4eb89-7538-4fc5-8973-2dafe6652df9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:31.468513 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-76e4eb89-7538-4fc5-8973-2dafe6652df9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:31.475574 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-76e4eb89-7538-4fc5-8973-2dafe6652df9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 200 len: 1221 microversion: 2.1 time: 0.080646 Feb 15 14:25:31.476144 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 106/210] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:31 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 1221 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:31.599821 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-07d4318b-c051-4b6c-9ea3-96df56d42b96 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:31.600443 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-07d4318b-c051-4b6c-9ea3-96df56d42b96 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:31.606221 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-07d4318b-c051-4b6c-9ea3-96df56d42b96 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:31.606670 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-07d4318b-c051-4b6c-9ea3-96df56d42b96 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:31.607473 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-07d4318b-c051-4b6c-9ea3-96df56d42b96 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:31.608454 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-07d4318b-c051-4b6c-9ea3-96df56d42b96 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:31.738108 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-07d4318b-c051-4b6c-9ea3-96df56d42b96 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:31.745386 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-07d4318b-c051-4b6c-9ea3-96df56d42b96 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1313 microversion: 2.1 time: 0.149167 Feb 15 14:25:31.745959 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 105/211] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:31 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:31.972951 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-df83a10e-46cd-43b6-ab75-bb808f30a4c6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:31.973500 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-df83a10e-46cd-43b6-ab75-bb808f30a4c6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:31.979333 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-df83a10e-46cd-43b6-ab75-bb808f30a4c6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:31.979775 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-df83a10e-46cd-43b6-ab75-bb808f30a4c6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:31.980583 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-df83a10e-46cd-43b6-ab75-bb808f30a4c6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:31.981016 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-df83a10e-46cd-43b6-ab75-bb808f30a4c6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:32.117569 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-df83a10e-46cd-43b6-ab75-bb808f30a4c6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:32.125376 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-df83a10e-46cd-43b6-ab75-bb808f30a4c6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.156079 Feb 15 14:25:32.125963 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 107/212] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:31 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:32.492838 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-ea8c8c41-27a5-4ae2-9e34-68595bf2c73a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:32.493546 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-ea8c8c41-27a5-4ae2-9e34-68595bf2c73a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:32.499618 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ea8c8c41-27a5-4ae2-9e34-68595bf2c73a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:32.500069 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ea8c8c41-27a5-4ae2-9e34-68595bf2c73a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:32.500885 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ea8c8c41-27a5-4ae2-9e34-68595bf2c73a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:32.501326 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ea8c8c41-27a5-4ae2-9e34-68595bf2c73a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:32.563258 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-ea8c8c41-27a5-4ae2-9e34-68595bf2c73a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:32.570440 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-ea8c8c41-27a5-4ae2-9e34-68595bf2c73a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 200 len: 1269 microversion: 2.1 time: 0.081978 Feb 15 14:25:32.571030 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 106/213] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:32 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 1269 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:32.762611 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-7ac71475-0478-4695-9063-68c9a8cfdad8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:32.763248 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-7ac71475-0478-4695-9063-68c9a8cfdad8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:32.771092 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7ac71475-0478-4695-9063-68c9a8cfdad8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:32.771424 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7ac71475-0478-4695-9063-68c9a8cfdad8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:32.772203 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7ac71475-0478-4695-9063-68c9a8cfdad8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:32.772685 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7ac71475-0478-4695-9063-68c9a8cfdad8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:32.911563 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-7ac71475-0478-4695-9063-68c9a8cfdad8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:32.919759 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-7ac71475-0478-4695-9063-68c9a8cfdad8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1313 microversion: 2.1 time: 0.160905 Feb 15 14:25:32.920725 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 108/214] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:32 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:33.142633 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-d5794c5b-220e-42a6-b489-2d5776f2fe3a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:33.143394 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-d5794c5b-220e-42a6-b489-2d5776f2fe3a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:33.149666 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d5794c5b-220e-42a6-b489-2d5776f2fe3a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:33.150415 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d5794c5b-220e-42a6-b489-2d5776f2fe3a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:33.151710 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d5794c5b-220e-42a6-b489-2d5776f2fe3a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:33.152237 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d5794c5b-220e-42a6-b489-2d5776f2fe3a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:33.385406 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-d5794c5b-220e-42a6-b489-2d5776f2fe3a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:33.393812 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-d5794c5b-220e-42a6-b489-2d5776f2fe3a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.255427 Feb 15 14:25:33.394390 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 107/215] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:33 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:33.587266 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-263481c5-992f-47d2-a61e-40ccb1b86a05 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:33.588164 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-263481c5-992f-47d2-a61e-40ccb1b86a05 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:33.596115 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-263481c5-992f-47d2-a61e-40ccb1b86a05 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:33.596953 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-263481c5-992f-47d2-a61e-40ccb1b86a05 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:33.598306 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-263481c5-992f-47d2-a61e-40ccb1b86a05 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:33.598983 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-263481c5-992f-47d2-a61e-40ccb1b86a05 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:33.664129 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-263481c5-992f-47d2-a61e-40ccb1b86a05 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:33.672199 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-263481c5-992f-47d2-a61e-40ccb1b86a05 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 200 len: 1275 microversion: 2.1 time: 0.089058 Feb 15 14:25:33.681865 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 109/216] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:33 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 1275 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:33.937401 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-73e31519-15da-4a00-851e-c4de5bfb54ad tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:33.939477 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-73e31519-15da-4a00-851e-c4de5bfb54ad tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:33.945444 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-73e31519-15da-4a00-851e-c4de5bfb54ad tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:33.945882 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-73e31519-15da-4a00-851e-c4de5bfb54ad tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:33.946687 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-73e31519-15da-4a00-851e-c4de5bfb54ad tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:33.947253 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-73e31519-15da-4a00-851e-c4de5bfb54ad tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:34.100338 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-73e31519-15da-4a00-851e-c4de5bfb54ad tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:34.107800 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-73e31519-15da-4a00-851e-c4de5bfb54ad tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1313 microversion: 2.1 time: 0.174989 Feb 15 14:25:34.108371 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 108/217] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:33 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:34.410373 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-5290bde0-9806-4cd4-a25d-47bb1ed11964 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:34.411077 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-5290bde0-9806-4cd4-a25d-47bb1ed11964 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:34.417829 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5290bde0-9806-4cd4-a25d-47bb1ed11964 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:34.418270 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5290bde0-9806-4cd4-a25d-47bb1ed11964 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:34.419034 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5290bde0-9806-4cd4-a25d-47bb1ed11964 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:34.419469 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5290bde0-9806-4cd4-a25d-47bb1ed11964 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:34.595653 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-5290bde0-9806-4cd4-a25d-47bb1ed11964 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:34.603108 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-5290bde0-9806-4cd4-a25d-47bb1ed11964 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.196189 Feb 15 14:25:34.603894 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 110/218] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:34 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:34.690998 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-82eb08ce-09dd-49bd-bae1-85b80715d560 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:34.691998 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-82eb08ce-09dd-49bd-bae1-85b80715d560 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:34.699338 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-82eb08ce-09dd-49bd-bae1-85b80715d560 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:34.699798 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-82eb08ce-09dd-49bd-bae1-85b80715d560 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:34.700597 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-82eb08ce-09dd-49bd-bae1-85b80715d560 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:34.701199 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-82eb08ce-09dd-49bd-bae1-85b80715d560 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:34.844709 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-82eb08ce-09dd-49bd-bae1-85b80715d560 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:34.851933 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-82eb08ce-09dd-49bd-bae1-85b80715d560 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 200 len: 1317 microversion: 2.1 time: 0.166669 Feb 15 14:25:34.852521 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 109/219] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:34 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:35.124982 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-93e109c6-d8fe-4f34-ac62-88c7d780953f tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:35.125791 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-93e109c6-d8fe-4f34-ac62-88c7d780953f tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:35.131932 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-93e109c6-d8fe-4f34-ac62-88c7d780953f tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:35.132383 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-93e109c6-d8fe-4f34-ac62-88c7d780953f tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:35.133248 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-93e109c6-d8fe-4f34-ac62-88c7d780953f tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:35.133628 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-93e109c6-d8fe-4f34-ac62-88c7d780953f tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:35.284567 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-93e109c6-d8fe-4f34-ac62-88c7d780953f tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:35.292021 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-93e109c6-d8fe-4f34-ac62-88c7d780953f tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1313 microversion: 2.1 time: 0.171325 Feb 15 14:25:35.292815 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 111/220] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:35 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:35.620082 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-227f2b66-1dd8-471f-9486-e3d138b1b825 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:35.620730 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-227f2b66-1dd8-471f-9486-e3d138b1b825 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:35.627143 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-227f2b66-1dd8-471f-9486-e3d138b1b825 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:35.627661 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-227f2b66-1dd8-471f-9486-e3d138b1b825 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:35.628540 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-227f2b66-1dd8-471f-9486-e3d138b1b825 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:35.629041 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-227f2b66-1dd8-471f-9486-e3d138b1b825 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:35.768414 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-227f2b66-1dd8-471f-9486-e3d138b1b825 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:35.777451 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-227f2b66-1dd8-471f-9486-e3d138b1b825 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.160967 Feb 15 14:25:35.778099 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 110/221] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:35 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:35.869033 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-59625292-2456-4790-9548-8ac5107282be tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:35.869641 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-59625292-2456-4790-9548-8ac5107282be tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:35.877183 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-59625292-2456-4790-9548-8ac5107282be tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:35.877637 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-59625292-2456-4790-9548-8ac5107282be tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:35.878413 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-59625292-2456-4790-9548-8ac5107282be tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:35.878848 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-59625292-2456-4790-9548-8ac5107282be tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:36.011001 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-59625292-2456-4790-9548-8ac5107282be tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:36.019096 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-59625292-2456-4790-9548-8ac5107282be tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 200 len: 1317 microversion: 2.1 time: 0.153599 Feb 15 14:25:36.028382 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 112/222] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:35 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:36.310406 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-0d2d9987-49ea-4da6-9dea-0b276f4b2ec7 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:36.311376 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-0d2d9987-49ea-4da6-9dea-0b276f4b2ec7 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:36.318420 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0d2d9987-49ea-4da6-9dea-0b276f4b2ec7 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:36.318920 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0d2d9987-49ea-4da6-9dea-0b276f4b2ec7 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:36.319954 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0d2d9987-49ea-4da6-9dea-0b276f4b2ec7 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:36.320962 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0d2d9987-49ea-4da6-9dea-0b276f4b2ec7 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:36.496432 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-0d2d9987-49ea-4da6-9dea-0b276f4b2ec7 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:36.503702 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-0d2d9987-49ea-4da6-9dea-0b276f4b2ec7 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1313 microversion: 2.1 time: 0.197772 Feb 15 14:25:36.504623 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 111/223] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:36 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:36.796712 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-73e92159-b2a4-4ac2-b747-f0a4751614b9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:36.797322 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-73e92159-b2a4-4ac2-b747-f0a4751614b9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:36.803363 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-73e92159-b2a4-4ac2-b747-f0a4751614b9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:36.803808 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-73e92159-b2a4-4ac2-b747-f0a4751614b9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:36.804611 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-73e92159-b2a4-4ac2-b747-f0a4751614b9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:36.805044 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-73e92159-b2a4-4ac2-b747-f0a4751614b9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:36.944386 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-73e92159-b2a4-4ac2-b747-f0a4751614b9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:36.952138 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-73e92159-b2a4-4ac2-b747-f0a4751614b9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.159209 Feb 15 14:25:36.952974 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 113/224] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:36 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:37.035850 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-0bd3953a-ae2d-4ca9-b37e-2a9411dc17a8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:37.036480 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-0bd3953a-ae2d-4ca9-b37e-2a9411dc17a8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:37.042596 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0bd3953a-ae2d-4ca9-b37e-2a9411dc17a8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:37.043081 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0bd3953a-ae2d-4ca9-b37e-2a9411dc17a8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:37.043879 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0bd3953a-ae2d-4ca9-b37e-2a9411dc17a8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:37.044331 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0bd3953a-ae2d-4ca9-b37e-2a9411dc17a8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:37.255040 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-0bd3953a-ae2d-4ca9-b37e-2a9411dc17a8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:37.262250 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-0bd3953a-ae2d-4ca9-b37e-2a9411dc17a8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 200 len: 1317 microversion: 2.1 time: 0.230373 Feb 15 14:25:37.262821 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 112/225] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:37 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:37.520653 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-a7788d6d-b3cb-4864-afc5-4c0292ee571c tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:37.521339 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-a7788d6d-b3cb-4864-afc5-4c0292ee571c tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:37.527282 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a7788d6d-b3cb-4864-afc5-4c0292ee571c tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:37.527717 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a7788d6d-b3cb-4864-afc5-4c0292ee571c tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:37.528496 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a7788d6d-b3cb-4864-afc5-4c0292ee571c tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:37.528925 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a7788d6d-b3cb-4864-afc5-4c0292ee571c tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:37.667550 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a7788d6d-b3cb-4864-afc5-4c0292ee571c tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:37.676035 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-a7788d6d-b3cb-4864-afc5-4c0292ee571c tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1313 microversion: 2.1 time: 0.158963 Feb 15 14:25:37.676764 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 114/226] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:37 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:37.969760 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-806b0f93-3a64-401a-9b90-105b86ff3481 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:37.970367 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-806b0f93-3a64-401a-9b90-105b86ff3481 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:37.976214 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-806b0f93-3a64-401a-9b90-105b86ff3481 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:37.976884 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-806b0f93-3a64-401a-9b90-105b86ff3481 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:37.977888 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-806b0f93-3a64-401a-9b90-105b86ff3481 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:37.978506 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-806b0f93-3a64-401a-9b90-105b86ff3481 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:38.214453 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-806b0f93-3a64-401a-9b90-105b86ff3481 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:38.226753 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-806b0f93-3a64-401a-9b90-105b86ff3481 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.261398 Feb 15 14:25:38.228220 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 113/227] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:37 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:38.283369 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-23c89b40-a381-428e-815d-94c606f2d18d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:38.283733 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-23c89b40-a381-428e-815d-94c606f2d18d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:38.291303 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-23c89b40-a381-428e-815d-94c606f2d18d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:38.291758 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-23c89b40-a381-428e-815d-94c606f2d18d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:38.292639 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-23c89b40-a381-428e-815d-94c606f2d18d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:38.293231 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-23c89b40-a381-428e-815d-94c606f2d18d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:38.457649 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-23c89b40-a381-428e-815d-94c606f2d18d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:38.466466 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-23c89b40-a381-428e-815d-94c606f2d18d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 200 len: 1317 microversion: 2.1 time: 0.190388 Feb 15 14:25:38.468377 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 115/228] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:38 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:38.527743 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-58f49dbf-58b9-43b6-a872-29b51f10ec94 req-0e3df023-bcc7-4fd2-8321-2eabf91ef760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a72c673c-5d13-4e5f-9372-4978fa30606e", "tag": "5a742ca0-cc9c-45f2-8721-966fe2c2f900"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:25:38.530044 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:25:38.530044 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:25:38.541304 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-58f49dbf-58b9-43b6-a872-29b51f10ec94 req-0e3df023-bcc7-4fd2-8321-2eabf91ef760 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:38.542003 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-58f49dbf-58b9-43b6-a872-29b51f10ec94 req-0e3df023-bcc7-4fd2-8321-2eabf91ef760 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:38.556164 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-58f49dbf-58b9-43b6-a872-29b51f10ec94 req-0e3df023-bcc7-4fd2-8321-2eabf91ef760 service nova] Creating event network-changed:5a742ca0-cc9c-45f2-8721-966fe2c2f900 for instance a72c673c-5d13-4e5f-9372-4978fa30606e on hv-cinder-81914 Feb 15 14:25:38.563668 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-58f49dbf-58b9-43b6-a872-29b51f10ec94 req-0e3df023-bcc7-4fd2-8321-2eabf91ef760 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039490 Feb 15 14:25:38.564280 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 114/229] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:25:38.699414 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-6e061baf-3b78-4da0-9a0b-ad1ce07b3a0e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:38.704436 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-6e061baf-3b78-4da0-9a0b-ad1ce07b3a0e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:38.712188 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6e061baf-3b78-4da0-9a0b-ad1ce07b3a0e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:38.712682 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6e061baf-3b78-4da0-9a0b-ad1ce07b3a0e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:38.713442 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6e061baf-3b78-4da0-9a0b-ad1ce07b3a0e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:38.713871 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6e061baf-3b78-4da0-9a0b-ad1ce07b3a0e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:38.891160 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-6e061baf-3b78-4da0-9a0b-ad1ce07b3a0e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:38.899141 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-6e061baf-3b78-4da0-9a0b-ad1ce07b3a0e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1313 microversion: 2.1 time: 0.209925 Feb 15 14:25:38.900246 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 116/230] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:38 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:39.245444 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-b655a772-139f-4936-be81-9818fc7edf8f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:39.246766 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-b655a772-139f-4936-be81-9818fc7edf8f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:39.254439 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b655a772-139f-4936-be81-9818fc7edf8f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:39.255154 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b655a772-139f-4936-be81-9818fc7edf8f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:39.256180 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b655a772-139f-4936-be81-9818fc7edf8f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:39.256852 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b655a772-139f-4936-be81-9818fc7edf8f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:39.484031 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-dffad43b-19fd-4411-918f-5bff95d35b7e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:39.484664 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-dffad43b-19fd-4411-918f-5bff95d35b7e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:39.491219 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dffad43b-19fd-4411-918f-5bff95d35b7e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:39.491668 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dffad43b-19fd-4411-918f-5bff95d35b7e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:39.492461 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dffad43b-19fd-4411-918f-5bff95d35b7e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:39.492899 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dffad43b-19fd-4411-918f-5bff95d35b7e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:39.604327 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-b655a772-139f-4936-be81-9818fc7edf8f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:39.616061 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-b655a772-139f-4936-be81-9818fc7edf8f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.374563 Feb 15 14:25:39.617069 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 115/231] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:39 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:39.641303 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-dffad43b-19fd-4411-918f-5bff95d35b7e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:39.654612 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-dffad43b-19fd-4411-918f-5bff95d35b7e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 200 len: 1317 microversion: 2.1 time: 0.174105 Feb 15 14:25:39.655218 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 117/232] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:39 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:39.917746 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-1a5170f0-ed3c-4b9a-ae82-1a6dd8b9a0c8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:39.918593 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-1a5170f0-ed3c-4b9a-ae82-1a6dd8b9a0c8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:39.925349 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1a5170f0-ed3c-4b9a-ae82-1a6dd8b9a0c8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:39.925972 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1a5170f0-ed3c-4b9a-ae82-1a6dd8b9a0c8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:39.927336 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1a5170f0-ed3c-4b9a-ae82-1a6dd8b9a0c8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:39.927909 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1a5170f0-ed3c-4b9a-ae82-1a6dd8b9a0c8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:39.931824 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-637dcb05-a69b-4fa6-9b47-614eb64ce08b req-208d2ce3-7c79-4006-87fb-586fcde5fd99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088", "name": "network-vif-plugged", "status": "completed", "tag": "4a81fcd4-23cd-426b-ab57-b98a52ed554d"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:25:39.933455 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:25:39.933455 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:25:39.958149 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-637dcb05-a69b-4fa6-9b47-614eb64ce08b req-208d2ce3-7c79-4006-87fb-586fcde5fd99 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:39.958589 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-637dcb05-a69b-4fa6-9b47-614eb64ce08b req-208d2ce3-7c79-4006-87fb-586fcde5fd99 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:39.983077 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-637dcb05-a69b-4fa6-9b47-614eb64ce08b req-208d2ce3-7c79-4006-87fb-586fcde5fd99 service nova] Creating event network-vif-plugged:4a81fcd4-23cd-426b-ab57-b98a52ed554d for instance a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 on hv-cinder-81914 Feb 15 14:25:39.995038 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-637dcb05-a69b-4fa6-9b47-614eb64ce08b req-208d2ce3-7c79-4006-87fb-586fcde5fd99 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066578 Feb 15 14:25:39.996387 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 118/233] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:25:40.094572 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-1a5170f0-ed3c-4b9a-ae82-1a6dd8b9a0c8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:40.106312 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-1a5170f0-ed3c-4b9a-ae82-1a6dd8b9a0c8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1313 microversion: 2.1 time: 0.192221 Feb 15 14:25:40.106689 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 116/234] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:39 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:40.634582 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-248c7719-820e-4c93-b264-b8f2f1d74fde tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:40.635312 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-248c7719-820e-4c93-b264-b8f2f1d74fde tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:40.644563 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-248c7719-820e-4c93-b264-b8f2f1d74fde tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:40.644563 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-248c7719-820e-4c93-b264-b8f2f1d74fde tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:40.644563 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-248c7719-820e-4c93-b264-b8f2f1d74fde tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:40.644563 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-248c7719-820e-4c93-b264-b8f2f1d74fde tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:40.672144 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-5b2fdb72-c27b-441e-9b06-510a66fbba87 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:40.672858 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-5b2fdb72-c27b-441e-9b06-510a66fbba87 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:40.679175 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5b2fdb72-c27b-441e-9b06-510a66fbba87 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:40.686845 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5b2fdb72-c27b-441e-9b06-510a66fbba87 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:40.687878 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5b2fdb72-c27b-441e-9b06-510a66fbba87 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:40.688576 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5b2fdb72-c27b-441e-9b06-510a66fbba87 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:40.817043 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-248c7719-820e-4c93-b264-b8f2f1d74fde tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:40.825490 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-248c7719-820e-4c93-b264-b8f2f1d74fde tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.194946 Feb 15 14:25:40.826865 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 119/235] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:40 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:40.859344 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-5b2fdb72-c27b-441e-9b06-510a66fbba87 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:40.882283 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-5b2fdb72-c27b-441e-9b06-510a66fbba87 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 200 len: 1317 microversion: 2.1 time: 0.198701 Feb 15 14:25:40.884034 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 117/236] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:40 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:41.124927 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-aa888ffc-8ac1-4667-a220-7be4936a58a6 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:41.125460 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-aa888ffc-8ac1-4667-a220-7be4936a58a6 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:41.135257 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-aa888ffc-8ac1-4667-a220-7be4936a58a6 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:41.135801 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-aa888ffc-8ac1-4667-a220-7be4936a58a6 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:41.136860 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-aa888ffc-8ac1-4667-a220-7be4936a58a6 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:41.137472 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-aa888ffc-8ac1-4667-a220-7be4936a58a6 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:41.327697 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-aa888ffc-8ac1-4667-a220-7be4936a58a6 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:41.335329 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-aa888ffc-8ac1-4667-a220-7be4936a58a6 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1313 microversion: 2.1 time: 0.216378 Feb 15 14:25:41.335920 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 120/237] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:41 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:41.843596 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-77e66f8d-ed4e-4f75-b5c4-9b975bcd5592 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:41.844200 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-77e66f8d-ed4e-4f75-b5c4-9b975bcd5592 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:41.852614 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-77e66f8d-ed4e-4f75-b5c4-9b975bcd5592 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:41.853343 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-77e66f8d-ed4e-4f75-b5c4-9b975bcd5592 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:41.854331 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-77e66f8d-ed4e-4f75-b5c4-9b975bcd5592 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:41.855536 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-77e66f8d-ed4e-4f75-b5c4-9b975bcd5592 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:41.902532 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-dace58e2-c80c-4f7d-b3f7-28c2c39324ee tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:41.903839 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-dace58e2-c80c-4f7d-b3f7-28c2c39324ee tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:41.921283 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dace58e2-c80c-4f7d-b3f7-28c2c39324ee tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:41.922580 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dace58e2-c80c-4f7d-b3f7-28c2c39324ee tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:41.923687 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dace58e2-c80c-4f7d-b3f7-28c2c39324ee tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:41.925450 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dace58e2-c80c-4f7d-b3f7-28c2c39324ee tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:42.097262 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-dace58e2-c80c-4f7d-b3f7-28c2c39324ee tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:42.105601 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-dace58e2-c80c-4f7d-b3f7-28c2c39324ee tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 200 len: 1317 microversion: 2.1 time: 0.208070 Feb 15 14:25:42.106223 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 121/238] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:41 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:42.117910 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-77e66f8d-ed4e-4f75-b5c4-9b975bcd5592 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:42.126719 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-77e66f8d-ed4e-4f75-b5c4-9b975bcd5592 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.286740 Feb 15 14:25:42.128108 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 118/239] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:41 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:42.352554 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-558859dd-98bf-4c36-b5b1-802c426e9c48 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:42.353406 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-558859dd-98bf-4c36-b5b1-802c426e9c48 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:42.361678 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-558859dd-98bf-4c36-b5b1-802c426e9c48 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:42.362325 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-558859dd-98bf-4c36-b5b1-802c426e9c48 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:42.363529 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-558859dd-98bf-4c36-b5b1-802c426e9c48 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:42.365112 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-558859dd-98bf-4c36-b5b1-802c426e9c48 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:42.527437 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-558859dd-98bf-4c36-b5b1-802c426e9c48 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:42.536330 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-558859dd-98bf-4c36-b5b1-802c426e9c48 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1313 microversion: 2.1 time: 0.187621 Feb 15 14:25:42.537682 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 122/240] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:42 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:43.124769 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-4ecc3e20-4a90-4c09-a27a-506de88bbdf8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:43.125466 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-4ecc3e20-4a90-4c09-a27a-506de88bbdf8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:43.131633 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4ecc3e20-4a90-4c09-a27a-506de88bbdf8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:43.132153 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4ecc3e20-4a90-4c09-a27a-506de88bbdf8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:43.133062 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4ecc3e20-4a90-4c09-a27a-506de88bbdf8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:43.133496 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4ecc3e20-4a90-4c09-a27a-506de88bbdf8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:43.142837 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-db137ba3-0d89-469f-97c8-38f53bcfab31 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:43.143432 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-db137ba3-0d89-469f-97c8-38f53bcfab31 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:43.150264 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-db137ba3-0d89-469f-97c8-38f53bcfab31 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:43.150841 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-db137ba3-0d89-469f-97c8-38f53bcfab31 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:43.151620 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-db137ba3-0d89-469f-97c8-38f53bcfab31 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:43.152048 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-db137ba3-0d89-469f-97c8-38f53bcfab31 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:43.286325 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-4ecc3e20-4a90-4c09-a27a-506de88bbdf8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:43.293411 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-db137ba3-0d89-469f-97c8-38f53bcfab31 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:43.300372 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-4ecc3e20-4a90-4c09-a27a-506de88bbdf8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 200 len: 1317 microversion: 2.1 time: 0.179994 Feb 15 14:25:43.300993 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 119/241] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:43 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:43.302093 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-db137ba3-0d89-469f-97c8-38f53bcfab31 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.162734 Feb 15 14:25:43.302677 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 123/242] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:43 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:43.554945 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-8402362a-654e-4db8-b1f1-26ae1b4aed4e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:43.555560 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-8402362a-654e-4db8-b1f1-26ae1b4aed4e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:43.561379 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8402362a-654e-4db8-b1f1-26ae1b4aed4e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:43.561848 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8402362a-654e-4db8-b1f1-26ae1b4aed4e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:43.562622 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8402362a-654e-4db8-b1f1-26ae1b4aed4e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:43.563058 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8402362a-654e-4db8-b1f1-26ae1b4aed4e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:43.707714 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-8402362a-654e-4db8-b1f1-26ae1b4aed4e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:43.714961 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-8402362a-654e-4db8-b1f1-26ae1b4aed4e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1496 microversion: 2.1 time: 0.163681 Feb 15 14:25:43.715566 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 120/243] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:43 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1496 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:44.318551 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-023c0e3e-2299-4ae0-8f3d-650923621a34 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:44.322896 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-53f11827-3fc0-44ec-9c4b-c31b9c62131e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:44.323662 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-53f11827-3fc0-44ec-9c4b-c31b9c62131e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:44.324002 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-023c0e3e-2299-4ae0-8f3d-650923621a34 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:44.330620 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-023c0e3e-2299-4ae0-8f3d-650923621a34 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:44.331163 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-023c0e3e-2299-4ae0-8f3d-650923621a34 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:44.332074 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-023c0e3e-2299-4ae0-8f3d-650923621a34 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:44.332561 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-023c0e3e-2299-4ae0-8f3d-650923621a34 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:44.333353 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-53f11827-3fc0-44ec-9c4b-c31b9c62131e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:44.333942 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-53f11827-3fc0-44ec-9c4b-c31b9c62131e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:44.334712 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-53f11827-3fc0-44ec-9c4b-c31b9c62131e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:44.335137 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-53f11827-3fc0-44ec-9c4b-c31b9c62131e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:44.473956 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-53f11827-3fc0-44ec-9c4b-c31b9c62131e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:44.477460 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-023c0e3e-2299-4ae0-8f3d-650923621a34 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:44.481297 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-53f11827-3fc0-44ec-9c4b-c31b9c62131e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 200 len: 1317 microversion: 2.1 time: 0.167515 Feb 15 14:25:44.481869 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 124/244] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:44 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:44.489742 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-023c0e3e-2299-4ae0-8f3d-650923621a34 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.174535 Feb 15 14:25:44.490320 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 121/245] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:44 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:45.498986 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-32e186dc-62f9-4f32-a237-4b838e333bdb tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:45.499636 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-32e186dc-62f9-4f32-a237-4b838e333bdb tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:45.506032 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-32e186dc-62f9-4f32-a237-4b838e333bdb tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:45.506479 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-32e186dc-62f9-4f32-a237-4b838e333bdb tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:45.507250 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-32e186dc-62f9-4f32-a237-4b838e333bdb tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:45.507683 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-32e186dc-62f9-4f32-a237-4b838e333bdb tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:45.515384 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-fc04ee40-7693-424c-8d27-3be45affdde8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:45.515981 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-fc04ee40-7693-424c-8d27-3be45affdde8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:45.521662 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fc04ee40-7693-424c-8d27-3be45affdde8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:45.522104 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fc04ee40-7693-424c-8d27-3be45affdde8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:45.522916 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fc04ee40-7693-424c-8d27-3be45affdde8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:45.523351 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fc04ee40-7693-424c-8d27-3be45affdde8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:45.650017 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-32e186dc-62f9-4f32-a237-4b838e333bdb tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:45.658688 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-32e186dc-62f9-4f32-a237-4b838e333bdb tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 200 len: 1317 microversion: 2.1 time: 0.164006 Feb 15 14:25:45.661950 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-fc04ee40-7693-424c-8d27-3be45affdde8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:45.664591 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 125/246] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:45 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:45.670517 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-fc04ee40-7693-424c-8d27-3be45affdde8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.158852 Feb 15 14:25:45.671136 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 122/247] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:45 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:46.676353 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-99eb193c-de05-4ecd-bb88-f63f487f77c9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:46.677075 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-99eb193c-de05-4ecd-bb88-f63f487f77c9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:46.688459 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-99eb193c-de05-4ecd-bb88-f63f487f77c9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:46.688789 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-99eb193c-de05-4ecd-bb88-f63f487f77c9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:46.689515 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-99eb193c-de05-4ecd-bb88-f63f487f77c9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:46.689674 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-179480f7-a75f-4b33-a75d-ac81207077ff tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:46.690334 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-99eb193c-de05-4ecd-bb88-f63f487f77c9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:46.690637 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-179480f7-a75f-4b33-a75d-ac81207077ff tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:46.698121 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-179480f7-a75f-4b33-a75d-ac81207077ff tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:46.698715 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-179480f7-a75f-4b33-a75d-ac81207077ff tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:46.699990 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-179480f7-a75f-4b33-a75d-ac81207077ff tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:46.700597 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-179480f7-a75f-4b33-a75d-ac81207077ff tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:46.851279 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-99eb193c-de05-4ecd-bb88-f63f487f77c9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:46.859322 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-99eb193c-de05-4ecd-bb88-f63f487f77c9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 200 len: 1317 microversion: 2.1 time: 0.186560 Feb 15 14:25:46.868657 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 126/248] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:46 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:47.043796 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-179480f7-a75f-4b33-a75d-ac81207077ff tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:47.051606 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-179480f7-a75f-4b33-a75d-ac81207077ff tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.367754 Feb 15 14:25:47.052179 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 123/249] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:46 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:47.877294 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-187fa8f7-96da-4f70-8634-0f28ca896cd8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:47.878606 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-187fa8f7-96da-4f70-8634-0f28ca896cd8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:47.885348 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-187fa8f7-96da-4f70-8634-0f28ca896cd8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:47.885610 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-187fa8f7-96da-4f70-8634-0f28ca896cd8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:47.886553 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-187fa8f7-96da-4f70-8634-0f28ca896cd8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:47.886988 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-187fa8f7-96da-4f70-8634-0f28ca896cd8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:48.053136 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-11257056-c0f0-4184-a2ec-d0cef1af667a tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:48.053136 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-11257056-c0f0-4184-a2ec-d0cef1af667a tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:48.062100 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-11257056-c0f0-4184-a2ec-d0cef1af667a tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:48.062100 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-11257056-c0f0-4184-a2ec-d0cef1af667a tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:48.069234 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-11257056-c0f0-4184-a2ec-d0cef1af667a tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:48.069780 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-11257056-c0f0-4184-a2ec-d0cef1af667a tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:48.079914 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-187fa8f7-96da-4f70-8634-0f28ca896cd8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:48.087502 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-187fa8f7-96da-4f70-8634-0f28ca896cd8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 200 len: 1317 microversion: 2.1 time: 0.214680 Feb 15 14:25:48.088085 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 127/250] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:47 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:48.092874 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-b0d863c5-a43b-42d0-968c-d4f09e474ee9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:48.093594 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-b0d863c5-a43b-42d0-968c-d4f09e474ee9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:48.099261 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b0d863c5-a43b-42d0-968c-d4f09e474ee9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:48.099708 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b0d863c5-a43b-42d0-968c-d4f09e474ee9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:48.110546 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b0d863c5-a43b-42d0-968c-d4f09e474ee9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:48.110994 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b0d863c5-a43b-42d0-968c-d4f09e474ee9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:48.112512 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-11257056-c0f0-4184-a2ec-d0cef1af667a tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Going to try to terminate instance {{(pid=116362) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 14:25:48.236864 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-11257056-c0f0-4184-a2ec-d0cef1af667a tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 204 len: 0 microversion: 2.1 time: 0.188830 Feb 15 14:25:48.237578 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 124/251] 10.222.0.83 () {58 vars in 1238 bytes} [Tue Feb 15 14:25:48 2022] DELETE /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 14:25:48.246945 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-57776890-2827-4bed-98f8-c2f094edf3f5 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:48.247914 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-57776890-2827-4bed-98f8-c2f094edf3f5 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:48.259439 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-57776890-2827-4bed-98f8-c2f094edf3f5 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:48.259439 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-57776890-2827-4bed-98f8-c2f094edf3f5 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:48.259439 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-57776890-2827-4bed-98f8-c2f094edf3f5 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:48.259439 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-57776890-2827-4bed-98f8-c2f094edf3f5 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:48.272079 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-b0d863c5-a43b-42d0-968c-d4f09e474ee9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:48.279993 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-b0d863c5-a43b-42d0-968c-d4f09e474ee9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.190876 Feb 15 14:25:48.289777 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 128/252] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:48 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:48.404171 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-57776890-2827-4bed-98f8-c2f094edf3f5 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:48.412466 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-57776890-2827-4bed-98f8-c2f094edf3f5 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1502 microversion: 2.1 time: 0.170316 Feb 15 14:25:48.413060 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 125/253] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:48 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1502 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:49.104713 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-98d880d6-adab-4a8b-8d89-2102b8b983f5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:49.105320 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-98d880d6-adab-4a8b-8d89-2102b8b983f5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:49.111672 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-98d880d6-adab-4a8b-8d89-2102b8b983f5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:49.112122 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-98d880d6-adab-4a8b-8d89-2102b8b983f5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:49.112927 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-98d880d6-adab-4a8b-8d89-2102b8b983f5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:49.113349 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-98d880d6-adab-4a8b-8d89-2102b8b983f5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:49.246408 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-98d880d6-adab-4a8b-8d89-2102b8b983f5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:49.254212 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-98d880d6-adab-4a8b-8d89-2102b8b983f5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 200 len: 1317 microversion: 2.1 time: 0.153199 Feb 15 14:25:49.254786 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 129/254] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:49 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:49.296680 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-0dda94a2-7d24-4e97-bd12-99925972e130 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:49.297319 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-0dda94a2-7d24-4e97-bd12-99925972e130 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:49.303102 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0dda94a2-7d24-4e97-bd12-99925972e130 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:49.303548 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0dda94a2-7d24-4e97-bd12-99925972e130 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:49.304314 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0dda94a2-7d24-4e97-bd12-99925972e130 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:49.304775 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0dda94a2-7d24-4e97-bd12-99925972e130 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:49.430117 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-0ca3b167-ebd6-4eed-b40e-5b7b96b89b12 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:49.430958 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-0ca3b167-ebd6-4eed-b40e-5b7b96b89b12 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:49.437487 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0ca3b167-ebd6-4eed-b40e-5b7b96b89b12 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:49.437932 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0ca3b167-ebd6-4eed-b40e-5b7b96b89b12 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:49.438719 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0ca3b167-ebd6-4eed-b40e-5b7b96b89b12 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:49.440205 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0ca3b167-ebd6-4eed-b40e-5b7b96b89b12 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:49.441580 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-0dda94a2-7d24-4e97-bd12-99925972e130 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:49.449531 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-0dda94a2-7d24-4e97-bd12-99925972e130 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.156557 Feb 15 14:25:49.450104 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 126/255] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:49 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:49.575746 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-0ca3b167-ebd6-4eed-b40e-5b7b96b89b12 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:49.584009 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-0ca3b167-ebd6-4eed-b40e-5b7b96b89b12 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1502 microversion: 2.1 time: 0.157548 Feb 15 14:25:49.584620 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 130/256] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:49 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:49.884660 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-ce6e569b-9d09-4408-9a28-a29f487c3c03 req-bbcc8ab9-fa82-4b91-92ae-af3f5accb9eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a72c673c-5d13-4e5f-9372-4978fa30606e", "name": "network-vif-plugged", "status": "completed", "tag": "5a742ca0-cc9c-45f2-8721-966fe2c2f900"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:25:49.886370 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:25:49.886370 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:25:49.893983 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-ce6e569b-9d09-4408-9a28-a29f487c3c03 req-bbcc8ab9-fa82-4b91-92ae-af3f5accb9eb service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:49.894468 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-ce6e569b-9d09-4408-9a28-a29f487c3c03 req-bbcc8ab9-fa82-4b91-92ae-af3f5accb9eb service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:49.905634 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-ce6e569b-9d09-4408-9a28-a29f487c3c03 req-bbcc8ab9-fa82-4b91-92ae-af3f5accb9eb service nova] Creating event network-vif-plugged:5a742ca0-cc9c-45f2-8721-966fe2c2f900 for instance a72c673c-5d13-4e5f-9372-4978fa30606e on hv-cinder-81914 Feb 15 14:25:49.910355 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-ce6e569b-9d09-4408-9a28-a29f487c3c03 req-bbcc8ab9-fa82-4b91-92ae-af3f5accb9eb service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029804 Feb 15 14:25:49.910944 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 127/257] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:25:50.270466 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-068a8dc7-21c8-4093-9981-d22adfc9dce9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:50.271847 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-068a8dc7-21c8-4093-9981-d22adfc9dce9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:50.280524 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-068a8dc7-21c8-4093-9981-d22adfc9dce9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:50.280973 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-068a8dc7-21c8-4093-9981-d22adfc9dce9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:50.281758 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-068a8dc7-21c8-4093-9981-d22adfc9dce9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:50.282368 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-068a8dc7-21c8-4093-9981-d22adfc9dce9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:50.435603 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-068a8dc7-21c8-4093-9981-d22adfc9dce9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:50.442956 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-068a8dc7-21c8-4093-9981-d22adfc9dce9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 200 len: 1317 microversion: 2.1 time: 0.176026 Feb 15 14:25:50.443593 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 131/258] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:50 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:50.467424 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-9f04be06-a34c-46fb-b149-c69ceebdc01e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:50.468239 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-9f04be06-a34c-46fb-b149-c69ceebdc01e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:50.475128 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9f04be06-a34c-46fb-b149-c69ceebdc01e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:50.475584 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9f04be06-a34c-46fb-b149-c69ceebdc01e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:50.476370 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9f04be06-a34c-46fb-b149-c69ceebdc01e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:50.476842 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9f04be06-a34c-46fb-b149-c69ceebdc01e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:50.602359 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-0713ee0a-2bf7-4359-8b34-c00b45478a8e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:50.602964 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-0713ee0a-2bf7-4359-8b34-c00b45478a8e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:50.610399 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0713ee0a-2bf7-4359-8b34-c00b45478a8e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:50.610852 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0713ee0a-2bf7-4359-8b34-c00b45478a8e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:50.611651 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0713ee0a-2bf7-4359-8b34-c00b45478a8e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:50.612083 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0713ee0a-2bf7-4359-8b34-c00b45478a8e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:50.616227 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-9f04be06-a34c-46fb-b149-c69ceebdc01e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:50.624531 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-9f04be06-a34c-46fb-b149-c69ceebdc01e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.161167 Feb 15 14:25:50.625116 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 128/259] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:50 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:50.758863 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-0713ee0a-2bf7-4359-8b34-c00b45478a8e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:50.766701 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-0713ee0a-2bf7-4359-8b34-c00b45478a8e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1502 microversion: 2.1 time: 0.168143 Feb 15 14:25:50.767641 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 132/260] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:50 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:51.461074 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-13b9eb26-08ef-4f05-a06d-4d016799b58c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:51.461689 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-13b9eb26-08ef-4f05-a06d-4d016799b58c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:51.468378 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-13b9eb26-08ef-4f05-a06d-4d016799b58c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:51.468987 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-13b9eb26-08ef-4f05-a06d-4d016799b58c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:51.469629 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-13b9eb26-08ef-4f05-a06d-4d016799b58c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:51.470064 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-13b9eb26-08ef-4f05-a06d-4d016799b58c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:51.614446 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-13b9eb26-08ef-4f05-a06d-4d016799b58c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:51.622202 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-13b9eb26-08ef-4f05-a06d-4d016799b58c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 200 len: 1317 microversion: 2.1 time: 0.164733 Feb 15 14:25:51.623370 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 129/261] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:51 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:51.641700 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-afe395c8-a5bc-4a46-90a9-f554364f3ad5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:51.642306 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-afe395c8-a5bc-4a46-90a9-f554364f3ad5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:51.648555 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-afe395c8-a5bc-4a46-90a9-f554364f3ad5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:51.649002 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-afe395c8-a5bc-4a46-90a9-f554364f3ad5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:51.649796 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-afe395c8-a5bc-4a46-90a9-f554364f3ad5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:51.650228 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-afe395c8-a5bc-4a46-90a9-f554364f3ad5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:51.782676 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-afe395c8-a5bc-4a46-90a9-f554364f3ad5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:51.784661 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-0a9c820a-ea21-4015-b562-1c89f5b7c58a tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:51.785501 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-0a9c820a-ea21-4015-b562-1c89f5b7c58a tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:51.790609 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-afe395c8-a5bc-4a46-90a9-f554364f3ad5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.153188 Feb 15 14:25:51.791182 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 133/262] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:51 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:51.791484 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0a9c820a-ea21-4015-b562-1c89f5b7c58a tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:51.791930 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0a9c820a-ea21-4015-b562-1c89f5b7c58a tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:51.792746 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0a9c820a-ea21-4015-b562-1c89f5b7c58a tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:51.793182 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0a9c820a-ea21-4015-b562-1c89f5b7c58a tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:51.931860 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-0a9c820a-ea21-4015-b562-1c89f5b7c58a tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:51.940460 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-0a9c820a-ea21-4015-b562-1c89f5b7c58a tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1502 microversion: 2.1 time: 0.159240 Feb 15 14:25:51.941209 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 130/263] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:51 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:52.659500 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-08e24b99-9887-4411-b155-994c1156e634 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:52.660448 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-08e24b99-9887-4411-b155-994c1156e634 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:52.673097 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-08e24b99-9887-4411-b155-994c1156e634 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:52.673547 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-08e24b99-9887-4411-b155-994c1156e634 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:52.674330 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-08e24b99-9887-4411-b155-994c1156e634 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:52.674769 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-08e24b99-9887-4411-b155-994c1156e634 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:52.749266 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-c8f7f019-ed66-4734-a9e3-e99944b634df req-f50fd8ad-0db1-4de9-9abe-86baca39334b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088", "name": "network-vif-deleted", "tag": "4a81fcd4-23cd-426b-ab57-b98a52ed554d"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:25:52.751277 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:25:52.751277 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:25:52.760730 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-c8f7f019-ed66-4734-a9e3-e99944b634df req-f50fd8ad-0db1-4de9-9abe-86baca39334b service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:52.761674 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-c8f7f019-ed66-4734-a9e3-e99944b634df req-f50fd8ad-0db1-4de9-9abe-86baca39334b service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:52.776513 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-c8f7f019-ed66-4734-a9e3-e99944b634df req-f50fd8ad-0db1-4de9-9abe-86baca39334b service nova] Creating event network-vif-deleted:4a81fcd4-23cd-426b-ab57-b98a52ed554d for instance a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 on hv-cinder-81914 Feb 15 14:25:52.785977 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-c8f7f019-ed66-4734-a9e3-e99944b634df req-f50fd8ad-0db1-4de9-9abe-86baca39334b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039348 Feb 15 14:25:52.788220 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 131/264] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:25:52.809998 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-a1751017-9f51-4949-805f-932d94ad7341 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:52.810736 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-a1751017-9f51-4949-805f-932d94ad7341 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:52.818263 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a1751017-9f51-4949-805f-932d94ad7341 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:52.819020 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a1751017-9f51-4949-805f-932d94ad7341 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:52.820201 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a1751017-9f51-4949-805f-932d94ad7341 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:52.821123 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a1751017-9f51-4949-805f-932d94ad7341 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:52.878622 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-08e24b99-9887-4411-b155-994c1156e634 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:52.890321 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-08e24b99-9887-4411-b155-994c1156e634 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 200 len: 1506 microversion: 2.1 time: 0.253655 Feb 15 14:25:52.891443 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 134/265] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:52 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:52.957186 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-a3bdbbb3-b2d9-443d-bea0-e9e03fef83b1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:52.957988 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-a3bdbbb3-b2d9-443d-bea0-e9e03fef83b1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:52.967319 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a3bdbbb3-b2d9-443d-bea0-e9e03fef83b1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:52.970973 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a3bdbbb3-b2d9-443d-bea0-e9e03fef83b1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:52.973119 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a3bdbbb3-b2d9-443d-bea0-e9e03fef83b1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:52.973737 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a3bdbbb3-b2d9-443d-bea0-e9e03fef83b1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:52.994580 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-a1751017-9f51-4949-805f-932d94ad7341 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:53.007383 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-a1751017-9f51-4949-805f-932d94ad7341 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.203551 Feb 15 14:25:53.011091 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 132/266] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:52 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:53.031631 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a3bdbbb3-b2d9-443d-bea0-e9e03fef83b1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:53.032090 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a3bdbbb3-b2d9-443d-bea0-e9e03fef83b1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:53.032587 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.objects.instance [None req-a3bdbbb3-b2d9-443d-bea0-e9e03fef83b1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lazy-loading 'fault' on Instance uuid a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 {{(pid=116363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:25:53.076496 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a3bdbbb3-b2d9-443d-bea0-e9e03fef83b1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:53.084573 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-a3bdbbb3-b2d9-443d-bea0-e9e03fef83b1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 200 len: 1303 microversion: 2.1 time: 0.130698 Feb 15 14:25:53.085556 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 135/267] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:52 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 1303 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:54.027762 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-e18cfddf-e1b2-442d-8879-e1738fa546b5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:54.028639 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-e18cfddf-e1b2-442d-8879-e1738fa546b5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:54.035028 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e18cfddf-e1b2-442d-8879-e1738fa546b5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:54.035807 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e18cfddf-e1b2-442d-8879-e1738fa546b5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:54.036894 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e18cfddf-e1b2-442d-8879-e1738fa546b5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:54.037330 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e18cfddf-e1b2-442d-8879-e1738fa546b5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:54.102033 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-03c936e1-b10b-4b17-aa63-cc21db1d85ff tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:54.102722 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-03c936e1-b10b-4b17-aa63-cc21db1d85ff tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:54.109656 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-03c936e1-b10b-4b17-aa63-cc21db1d85ff tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:54.110238 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-03c936e1-b10b-4b17-aa63-cc21db1d85ff tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:54.111213 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-03c936e1-b10b-4b17-aa63-cc21db1d85ff tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:54.111698 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-03c936e1-b10b-4b17-aa63-cc21db1d85ff tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:54.127817 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.wsgi [None req-03c936e1-b10b-4b17-aa63-cc21db1d85ff tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] HTTP exception thrown: Instance a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 could not be found. Feb 15 14:25:54.128425 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-03c936e1-b10b-4b17-aa63-cc21db1d85ff tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Returning 404 to user: Instance a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 could not be found. {{(pid=116363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:25:54.129258 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-03c936e1-b10b-4b17-aa63-cc21db1d85ff tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088" status: 404 len: 111 microversion: 2.1 time: 0.031166 Feb 15 14:25:54.129799 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 136/268] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:54 2022] GET /compute/v2.1/servers/a32e18f0-3c42-4ba7-98ad-0f1fa7ccb088 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 15 14:25:54.190160 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-e18cfddf-e1b2-442d-8879-e1738fa546b5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:54.197384 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-e18cfddf-e1b2-442d-8879-e1738fa546b5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.174184 Feb 15 14:25:54.197961 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 133/269] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:54 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:54.243545 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-39fc3c23-01f3-4cbb-aa82-76b97d3436e1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-48937170", "imageRef": "da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53", "flavorRef": "452", "networks": [{"uuid": "ae35ad6c-d134-4864-852a-972a5c0cf360"}]}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:25:54.306703 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.network.neutron [None req-39fc3c23-01f3-4cbb-aa82-76b97d3436e1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] validate_networks() for [('ae35ad6c-d134-4864-852a-972a5c0cf360', None, None, None, None, None)] {{(pid=116363) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 14:25:54.321221 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-7fb0a500-abb0-4eb9-b7b1-3b736e64db8b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d566a05-a445-404e-b0d4-8109b848351e"}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:25:54.322271 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-7fb0a500-abb0-4eb9-b7b1-3b736e64db8b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:54.328997 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7fb0a500-abb0-4eb9-b7b1-3b736e64db8b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:54.329442 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7fb0a500-abb0-4eb9-b7b1-3b736e64db8b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:54.330228 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7fb0a500-abb0-4eb9-b7b1-3b736e64db8b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:54.330661 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7fb0a500-abb0-4eb9-b7b1-3b736e64db8b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:54.681792 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-39fc3c23-01f3-4cbb-aa82-76b97d3436e1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Flavor limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 14:25:54.681792 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-39fc3c23-01f3-4cbb-aa82-76b97d3436e1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Image limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 14:25:54.681792 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-39fc3c23-01f3-4cbb-aa82-76b97d3436e1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Flavor pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 14:25:54.681792 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-39fc3c23-01f3-4cbb-aa82-76b97d3436e1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Image pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 14:25:54.681792 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-39fc3c23-01f3-4cbb-aa82-76b97d3436e1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 14:25:54.692308 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-39fc3c23-01f3-4cbb-aa82-76b97d3436e1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:54.692786 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-39fc3c23-01f3-4cbb-aa82-76b97d3436e1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:54.693580 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-39fc3c23-01f3-4cbb-aa82-76b97d3436e1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:54.694003 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-39fc3c23-01f3-4cbb-aa82-76b97d3436e1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:54.712001 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-39fc3c23-01f3-4cbb-aa82-76b97d3436e1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Getting quotas for project 8f2b25b171d84f23bca58cdb0eb675c6. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:25:54.716888 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-39fc3c23-01f3-4cbb-aa82-76b97d3436e1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Getting quotas for user 23066575a3f64880a5106edf8004f737 and project 8f2b25b171d84f23bca58cdb0eb675c6. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:25:54.727385 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-39fc3c23-01f3-4cbb-aa82-76b97d3436e1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Going to run 1 instances... {{(pid=116363) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 14:25:54.730168 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-39fc3c23-01f3-4cbb-aa82-76b97d3436e1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 14:25:54.778242 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-39fc3c23-01f3-4cbb-aa82-76b97d3436e1 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538171 Feb 15 14:25:54.779584 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 137/270] 10.222.0.83 () {60 vars in 1146 bytes} [Tue Feb 15 14:25:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 14:25:54.789098 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-f054e983-f0cd-48f7-8c99-ff26a91d9c87 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:54.789701 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-f054e983-f0cd-48f7-8c99-ff26a91d9c87 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:54.842461 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-f054e983-f0cd-48f7-8c99-ff26a91d9c87 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:54.849155 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-f054e983-f0cd-48f7-8c99-ff26a91d9c87 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637" status: 200 len: 1212 microversion: 2.1 time: 0.063724 Feb 15 14:25:54.849716 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 138/271] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:54 2022] GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637 => generated 1212 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:55.215146 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-03fb189a-ad2b-4d13-8eeb-a6a4931ce9b1 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:55.215778 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-03fb189a-ad2b-4d13-8eeb-a6a4931ce9b1 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:55.222778 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-03fb189a-ad2b-4d13-8eeb-a6a4931ce9b1 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:55.223227 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-03fb189a-ad2b-4d13-8eeb-a6a4931ce9b1 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:55.223989 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-03fb189a-ad2b-4d13-8eeb-a6a4931ce9b1 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:55.224441 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-03fb189a-ad2b-4d13-8eeb-a6a4931ce9b1 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:55.362790 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-03fb189a-ad2b-4d13-8eeb-a6a4931ce9b1 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:55.370061 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-03fb189a-ad2b-4d13-8eeb-a6a4931ce9b1 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.158843 Feb 15 14:25:55.370622 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 139/272] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:55 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:55.866190 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-a7e31caa-4e15-486f-9e74-ed9a1e5869ae tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:55.867252 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-a7e31caa-4e15-486f-9e74-ed9a1e5869ae tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:55.873924 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a7e31caa-4e15-486f-9e74-ed9a1e5869ae tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:55.874372 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a7e31caa-4e15-486f-9e74-ed9a1e5869ae tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:55.875186 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a7e31caa-4e15-486f-9e74-ed9a1e5869ae tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:55.875642 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a7e31caa-4e15-486f-9e74-ed9a1e5869ae tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:55.932876 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a7e31caa-4e15-486f-9e74-ed9a1e5869ae tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:55.940711 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-a7e31caa-4e15-486f-9e74-ed9a1e5869ae tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637" status: 200 len: 1216 microversion: 2.1 time: 0.078138 Feb 15 14:25:55.941278 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 140/273] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:55 2022] GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637 => generated 1216 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:56.386610 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-4130a333-8ae4-4b16-8e0c-23cfd51c2896 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:56.387223 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-4130a333-8ae4-4b16-8e0c-23cfd51c2896 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:56.393555 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4130a333-8ae4-4b16-8e0c-23cfd51c2896 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:56.394007 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4130a333-8ae4-4b16-8e0c-23cfd51c2896 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:56.394778 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4130a333-8ae4-4b16-8e0c-23cfd51c2896 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:56.395210 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4130a333-8ae4-4b16-8e0c-23cfd51c2896 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:56.525599 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-4130a333-8ae4-4b16-8e0c-23cfd51c2896 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:56.533215 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-4130a333-8ae4-4b16-8e0c-23cfd51c2896 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.150203 Feb 15 14:25:56.533804 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 141/274] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:56 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:56.957248 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-138b004b-e12a-4c05-bfa8-ce5e42920854 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:56.957801 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-138b004b-e12a-4c05-bfa8-ce5e42920854 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:56.963748 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-138b004b-e12a-4c05-bfa8-ce5e42920854 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:56.964200 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-138b004b-e12a-4c05-bfa8-ce5e42920854 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:56.965002 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-138b004b-e12a-4c05-bfa8-ce5e42920854 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:56.965437 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-138b004b-e12a-4c05-bfa8-ce5e42920854 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:57.029784 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-138b004b-e12a-4c05-bfa8-ce5e42920854 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:57.037567 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-138b004b-e12a-4c05-bfa8-ce5e42920854 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637" status: 200 len: 1216 microversion: 2.1 time: 0.084021 Feb 15 14:25:57.038137 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 142/275] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:56 2022] GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637 => generated 1216 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:57.549200 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-de67b69c-e2c7-4815-bca3-d12152c6c7c7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:57.549843 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-de67b69c-e2c7-4815-bca3-d12152c6c7c7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:57.556180 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-de67b69c-e2c7-4815-bca3-d12152c6c7c7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:57.556665 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-de67b69c-e2c7-4815-bca3-d12152c6c7c7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:57.557442 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-de67b69c-e2c7-4815-bca3-d12152c6c7c7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:57.557877 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-de67b69c-e2c7-4815-bca3-d12152c6c7c7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:57.688791 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-de67b69c-e2c7-4815-bca3-d12152c6c7c7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:57.696043 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-de67b69c-e2c7-4815-bca3-d12152c6c7c7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.150474 Feb 15 14:25:57.696650 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 143/276] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:57 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:58.054935 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-a7e6998a-c14e-40cc-9b11-670bcec6e6d2 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:58.055481 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-a7e6998a-c14e-40cc-9b11-670bcec6e6d2 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:58.062134 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a7e6998a-c14e-40cc-9b11-670bcec6e6d2 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:58.062579 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a7e6998a-c14e-40cc-9b11-670bcec6e6d2 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:58.063341 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a7e6998a-c14e-40cc-9b11-670bcec6e6d2 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:58.063766 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a7e6998a-c14e-40cc-9b11-670bcec6e6d2 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:58.127280 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a7e6998a-c14e-40cc-9b11-670bcec6e6d2 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:58.144666 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-a7e6998a-c14e-40cc-9b11-670bcec6e6d2 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637" status: 200 len: 1216 microversion: 2.1 time: 0.093303 Feb 15 14:25:58.145219 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 144/277] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:58 2022] GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637 => generated 1216 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:25:58.244599 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-7fb0a500-abb0-4eb9-b7b1-3b736e64db8b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "POST /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.927012 Feb 15 14:25:58.245218 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 134/278] 10.222.0.83 () {60 vars in 1322 bytes} [Tue Feb 15 14:25:54 2022] POST /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e/os-volume_attachments => generated 194 bytes in 3929 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:25:58.713724 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-bf3093b4-beae-4cba-b5c5-48faa2ef86af tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:58.714223 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-bf3093b4-beae-4cba-b5c5-48faa2ef86af tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:58.720709 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bf3093b4-beae-4cba-b5c5-48faa2ef86af tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:58.721160 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bf3093b4-beae-4cba-b5c5-48faa2ef86af tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:58.721931 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bf3093b4-beae-4cba-b5c5-48faa2ef86af tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:58.722367 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bf3093b4-beae-4cba-b5c5-48faa2ef86af tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:58.862209 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-bf3093b4-beae-4cba-b5c5-48faa2ef86af tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:58.869527 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-bf3093b4-beae-4cba-b5c5-48faa2ef86af tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.159538 Feb 15 14:25:58.870106 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 145/279] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:58 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:59.162449 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-6f3f2577-9bca-4cc2-9757-8c062336069e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:59.163257 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-6f3f2577-9bca-4cc2-9757-8c062336069e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:59.171380 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6f3f2577-9bca-4cc2-9757-8c062336069e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:59.171913 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6f3f2577-9bca-4cc2-9757-8c062336069e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:59.172809 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6f3f2577-9bca-4cc2-9757-8c062336069e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:59.173312 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6f3f2577-9bca-4cc2-9757-8c062336069e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:59.253180 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-6f3f2577-9bca-4cc2-9757-8c062336069e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:25:59.261204 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-6f3f2577-9bca-4cc2-9757-8c062336069e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637" status: 200 len: 1272 microversion: 2.1 time: 0.103475 Feb 15 14:25:59.261771 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 135/280] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:59 2022] GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637 => generated 1272 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:25:59.887089 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-495936c5-2f5b-492a-9e43-2e2cd4212001 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:25:59.888316 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-495936c5-2f5b-492a-9e43-2e2cd4212001 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:25:59.895093 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-495936c5-2f5b-492a-9e43-2e2cd4212001 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:59.895555 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-495936c5-2f5b-492a-9e43-2e2cd4212001 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:25:59.896336 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-495936c5-2f5b-492a-9e43-2e2cd4212001 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:25:59.896981 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-495936c5-2f5b-492a-9e43-2e2cd4212001 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:00.070471 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-495936c5-2f5b-492a-9e43-2e2cd4212001 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:00.078945 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-495936c5-2f5b-492a-9e43-2e2cd4212001 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.196308 Feb 15 14:26:00.080102 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 146/281] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:25:59 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:00.279511 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-c17f412e-bc90-4ef0-ac88-9fc69250cf6d tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:00.280274 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-c17f412e-bc90-4ef0-ac88-9fc69250cf6d tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:00.287316 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c17f412e-bc90-4ef0-ac88-9fc69250cf6d tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:00.288095 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c17f412e-bc90-4ef0-ac88-9fc69250cf6d tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:00.289232 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c17f412e-bc90-4ef0-ac88-9fc69250cf6d tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:00.289527 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c17f412e-bc90-4ef0-ac88-9fc69250cf6d tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:00.534830 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-c17f412e-bc90-4ef0-ac88-9fc69250cf6d tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:00.549335 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-c17f412e-bc90-4ef0-ac88-9fc69250cf6d tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637" status: 200 len: 1312 microversion: 2.1 time: 0.274199 Feb 15 14:26:00.561994 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 136/282] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:00 2022] GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637 => generated 1312 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:00.693955 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-55bca7ae-2f26-44b1-a711-912354521d7d req-b55fe9b1-d3f5-4f87-aeb7-b2a514c243fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a5da8f-7b06-4477-91dc-61ab6453e637", "tag": "7c6fea78-c836-4b6b-ace4-8c39c21bdb6f"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:26:00.696367 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:26:00.696367 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:26:00.704597 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-55bca7ae-2f26-44b1-a711-912354521d7d req-b55fe9b1-d3f5-4f87-aeb7-b2a514c243fd service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:00.705047 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-55bca7ae-2f26-44b1-a711-912354521d7d req-b55fe9b1-d3f5-4f87-aeb7-b2a514c243fd service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:00.718878 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-55bca7ae-2f26-44b1-a711-912354521d7d req-b55fe9b1-d3f5-4f87-aeb7-b2a514c243fd service nova] Creating event network-changed:7c6fea78-c836-4b6b-ace4-8c39c21bdb6f for instance 50a5da8f-7b06-4477-91dc-61ab6453e637 on hv-cinder-81914 Feb 15 14:26:00.724377 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-55bca7ae-2f26-44b1-a711-912354521d7d req-b55fe9b1-d3f5-4f87-aeb7-b2a514c243fd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034199 Feb 15 14:26:00.724991 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 147/283] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:26:01.096516 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-79b401bd-e03c-45dc-a23f-2355e93521d0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:01.097248 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-79b401bd-e03c-45dc-a23f-2355e93521d0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:01.103863 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-79b401bd-e03c-45dc-a23f-2355e93521d0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:01.104311 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-79b401bd-e03c-45dc-a23f-2355e93521d0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:01.105131 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-79b401bd-e03c-45dc-a23f-2355e93521d0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:01.105561 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-79b401bd-e03c-45dc-a23f-2355e93521d0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:01.260532 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-79b401bd-e03c-45dc-a23f-2355e93521d0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:01.269874 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-79b401bd-e03c-45dc-a23f-2355e93521d0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.177262 Feb 15 14:26:01.270467 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 137/284] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:01 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:01.575790 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-6d03d611-cdef-4ca5-a6c2-5a589aeffafe tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:01.575790 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-6d03d611-cdef-4ca5-a6c2-5a589aeffafe tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:01.580580 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6d03d611-cdef-4ca5-a6c2-5a589aeffafe tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:01.581015 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6d03d611-cdef-4ca5-a6c2-5a589aeffafe tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:01.581784 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6d03d611-cdef-4ca5-a6c2-5a589aeffafe tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:01.582212 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6d03d611-cdef-4ca5-a6c2-5a589aeffafe tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:01.737819 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-6d03d611-cdef-4ca5-a6c2-5a589aeffafe tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:01.745250 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-6d03d611-cdef-4ca5-a6c2-5a589aeffafe tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637" status: 200 len: 1312 microversion: 2.1 time: 0.181526 Feb 15 14:26:01.745819 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 148/285] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:01 2022] GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637 => generated 1312 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:26:02.287384 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-65c660dd-32b2-44c3-b37a-ac9deed45ac2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:02.287991 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-65c660dd-32b2-44c3-b37a-ac9deed45ac2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:02.296014 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-65c660dd-32b2-44c3-b37a-ac9deed45ac2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:02.297984 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-65c660dd-32b2-44c3-b37a-ac9deed45ac2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:02.299104 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-65c660dd-32b2-44c3-b37a-ac9deed45ac2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:02.299766 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-65c660dd-32b2-44c3-b37a-ac9deed45ac2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:02.460422 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-65c660dd-32b2-44c3-b37a-ac9deed45ac2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:02.469187 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-65c660dd-32b2-44c3-b37a-ac9deed45ac2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.185641 Feb 15 14:26:02.469790 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 138/286] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:02 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:02.762094 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-45975e89-8d5c-4065-b2fe-fd99166dcd06 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:02.763329 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-45975e89-8d5c-4065-b2fe-fd99166dcd06 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:02.769687 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-45975e89-8d5c-4065-b2fe-fd99166dcd06 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:02.770132 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-45975e89-8d5c-4065-b2fe-fd99166dcd06 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:02.770894 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-45975e89-8d5c-4065-b2fe-fd99166dcd06 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:02.771324 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-45975e89-8d5c-4065-b2fe-fd99166dcd06 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:02.916634 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-45975e89-8d5c-4065-b2fe-fd99166dcd06 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:02.924474 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-45975e89-8d5c-4065-b2fe-fd99166dcd06 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637" status: 200 len: 1312 microversion: 2.1 time: 0.165991 Feb 15 14:26:02.925035 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 149/287] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:02 2022] GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637 => generated 1312 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:03.486255 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-06851dc1-60ae-4ff3-a8cb-63717322e16a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:03.486862 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-06851dc1-60ae-4ff3-a8cb-63717322e16a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:03.493129 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-06851dc1-60ae-4ff3-a8cb-63717322e16a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:03.493581 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-06851dc1-60ae-4ff3-a8cb-63717322e16a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:03.494352 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-06851dc1-60ae-4ff3-a8cb-63717322e16a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:03.494790 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-06851dc1-60ae-4ff3-a8cb-63717322e16a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:03.627199 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-06851dc1-60ae-4ff3-a8cb-63717322e16a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:03.634521 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-06851dc1-60ae-4ff3-a8cb-63717322e16a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.152062 Feb 15 14:26:03.635084 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 139/288] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:03 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:03.940718 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-5cad27a9-61e8-49e7-9022-6c2eea88a81b tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:03.941321 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-5cad27a9-61e8-49e7-9022-6c2eea88a81b tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:03.947438 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5cad27a9-61e8-49e7-9022-6c2eea88a81b tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:03.947912 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5cad27a9-61e8-49e7-9022-6c2eea88a81b tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:03.948707 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5cad27a9-61e8-49e7-9022-6c2eea88a81b tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:03.949137 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5cad27a9-61e8-49e7-9022-6c2eea88a81b tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:04.089920 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-5cad27a9-61e8-49e7-9022-6c2eea88a81b tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:04.097370 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-5cad27a9-61e8-49e7-9022-6c2eea88a81b tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637" status: 200 len: 1312 microversion: 2.1 time: 0.160192 Feb 15 14:26:04.097949 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 150/289] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:03 2022] GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637 => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:26:04.654165 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-60dd563e-9ff6-41ae-b25a-e3291b29209a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:04.654845 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-60dd563e-9ff6-41ae-b25a-e3291b29209a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:04.662159 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-60dd563e-9ff6-41ae-b25a-e3291b29209a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:04.662607 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-60dd563e-9ff6-41ae-b25a-e3291b29209a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:04.663387 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-60dd563e-9ff6-41ae-b25a-e3291b29209a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:04.663826 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-60dd563e-9ff6-41ae-b25a-e3291b29209a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:04.811042 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-60dd563e-9ff6-41ae-b25a-e3291b29209a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:04.819867 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-60dd563e-9ff6-41ae-b25a-e3291b29209a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.170700 Feb 15 14:26:04.820895 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 140/290] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:04 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:05.114952 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-2e4722d8-0d44-4ca3-9645-58dc6cf2d618 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:05.115564 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-2e4722d8-0d44-4ca3-9645-58dc6cf2d618 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:05.122375 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2e4722d8-0d44-4ca3-9645-58dc6cf2d618 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:05.122826 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2e4722d8-0d44-4ca3-9645-58dc6cf2d618 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:05.123597 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2e4722d8-0d44-4ca3-9645-58dc6cf2d618 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:05.124030 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2e4722d8-0d44-4ca3-9645-58dc6cf2d618 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:05.257207 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-2e4722d8-0d44-4ca3-9645-58dc6cf2d618 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:05.264372 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-2e4722d8-0d44-4ca3-9645-58dc6cf2d618 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637" status: 200 len: 1312 microversion: 2.1 time: 0.153062 Feb 15 14:26:05.264950 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 151/291] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:05 2022] GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637 => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:05.837001 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-0cc0e0ad-0b12-4e67-81cc-0fcd0921fb2e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:05.837632 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-0cc0e0ad-0b12-4e67-81cc-0fcd0921fb2e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:05.844269 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0cc0e0ad-0b12-4e67-81cc-0fcd0921fb2e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:05.844702 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0cc0e0ad-0b12-4e67-81cc-0fcd0921fb2e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:05.845468 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0cc0e0ad-0b12-4e67-81cc-0fcd0921fb2e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:05.845894 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0cc0e0ad-0b12-4e67-81cc-0fcd0921fb2e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:05.978666 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-0cc0e0ad-0b12-4e67-81cc-0fcd0921fb2e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:05.986055 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-0cc0e0ad-0b12-4e67-81cc-0fcd0921fb2e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.152631 Feb 15 14:26:05.986624 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 141/292] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:05 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:06.281091 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-40db2bd9-20ce-4a84-a795-06fccdbac4be tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:06.281615 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-40db2bd9-20ce-4a84-a795-06fccdbac4be tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:06.288156 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-40db2bd9-20ce-4a84-a795-06fccdbac4be tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:06.288634 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-40db2bd9-20ce-4a84-a795-06fccdbac4be tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:06.289414 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-40db2bd9-20ce-4a84-a795-06fccdbac4be tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:06.289841 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-40db2bd9-20ce-4a84-a795-06fccdbac4be tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:06.424980 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-40db2bd9-20ce-4a84-a795-06fccdbac4be tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:06.433534 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-40db2bd9-20ce-4a84-a795-06fccdbac4be tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637" status: 200 len: 1312 microversion: 2.1 time: 0.156442 Feb 15 14:26:06.443989 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 152/293] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:06 2022] GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637 => generated 1312 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:06.807356 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-863e0894-9e7c-4d90-9a83-7401a667627a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d566a05-a445-404e-b0d4-8109b848351e"}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:26:06.808615 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-863e0894-9e7c-4d90-9a83-7401a667627a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:06.815286 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-863e0894-9e7c-4d90-9a83-7401a667627a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:06.815748 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-863e0894-9e7c-4d90-9a83-7401a667627a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:06.816568 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-863e0894-9e7c-4d90-9a83-7401a667627a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:06.817012 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-863e0894-9e7c-4d90-9a83-7401a667627a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:06.908427 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.wsgi [None req-863e0894-9e7c-4d90-9a83-7401a667627a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] HTTP exception thrown: Invalid volume: volume 8d566a05-a445-404e-b0d4-8109b848351e is already attached to instances: a72c673c-5d13-4e5f-9372-4978fa30606e Feb 15 14:26:06.909042 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-863e0894-9e7c-4d90-9a83-7401a667627a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Returning 400 to user: Invalid volume: volume 8d566a05-a445-404e-b0d4-8109b848351e is already attached to instances: a72c673c-5d13-4e5f-9372-4978fa30606e {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:26:06.909875 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-863e0894-9e7c-4d90-9a83-7401a667627a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "POST /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106504 Feb 15 14:26:06.910433 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 142/294] 10.222.0.83 () {60 vars in 1322 bytes} [Tue Feb 15 14:26:06 2022] POST /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 15 14:26:06.971439 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-e38af29b-8d40-4bf4-ba1f-78ebe25bb379 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:06.971912 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-e38af29b-8d40-4bf4-ba1f-78ebe25bb379 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:06.977862 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e38af29b-8d40-4bf4-ba1f-78ebe25bb379 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:06.978306 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e38af29b-8d40-4bf4-ba1f-78ebe25bb379 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:06.979075 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e38af29b-8d40-4bf4-ba1f-78ebe25bb379 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:06.979506 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e38af29b-8d40-4bf4-ba1f-78ebe25bb379 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:07.003745 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-17b5f6dd-f71f-4226-9f75-42684d1f9728 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:07.004595 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-17b5f6dd-f71f-4226-9f75-42684d1f9728 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:07.014102 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-17b5f6dd-f71f-4226-9f75-42684d1f9728 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:07.014560 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-17b5f6dd-f71f-4226-9f75-42684d1f9728 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:07.015473 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-17b5f6dd-f71f-4226-9f75-42684d1f9728 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:07.015909 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-17b5f6dd-f71f-4226-9f75-42684d1f9728 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:07.102506 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.objects.instance [None req-e38af29b-8d40-4bf4-ba1f-78ebe25bb379 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lazy-loading 'services' on Instance uuid a72c673c-5d13-4e5f-9372-4978fa30606e {{(pid=116363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:26:07.223398 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-e38af29b-8d40-4bf4-ba1f-78ebe25bb379 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e/os-volume_attachments/8d566a05-a445-404e-b0d4-8109b848351e" status: 202 len: 0 microversion: 2.1 time: 0.255449 Feb 15 14:26:07.224087 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 153/295] 10.222.0.83 () {58 vars in 1415 bytes} [Tue Feb 15 14:26:06 2022] DELETE /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e/os-volume_attachments/8d566a05-a445-404e-b0d4-8109b848351e => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:26:07.233628 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-d30cd394-5c69-4414-9794-7ed913c7171f tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:07.234686 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-d30cd394-5c69-4414-9794-7ed913c7171f tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:07.242404 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d30cd394-5c69-4414-9794-7ed913c7171f tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:07.243487 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d30cd394-5c69-4414-9794-7ed913c7171f tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:07.244340 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d30cd394-5c69-4414-9794-7ed913c7171f tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:07.244840 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d30cd394-5c69-4414-9794-7ed913c7171f tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:07.279946 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-d30cd394-5c69-4414-9794-7ed913c7171f tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051394 Feb 15 14:26:07.280772 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 154/296] 10.222.0.83 () {58 vars in 1301 bytes} [Tue Feb 15 14:26:07 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:26:07.350779 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-17b5f6dd-f71f-4226-9f75-42684d1f9728 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:07.358572 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-17b5f6dd-f71f-4226-9f75-42684d1f9728 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.359250 Feb 15 14:26:07.359211 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 143/297] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:06 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:26:07.450984 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-02abcec3-e389-4b0d-b6df-ce8422c318ac tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:07.451583 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-02abcec3-e389-4b0d-b6df-ce8422c318ac tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:07.457918 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-02abcec3-e389-4b0d-b6df-ce8422c318ac tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:07.458577 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-02abcec3-e389-4b0d-b6df-ce8422c318ac tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:07.459102 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-02abcec3-e389-4b0d-b6df-ce8422c318ac tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:07.459526 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-02abcec3-e389-4b0d-b6df-ce8422c318ac tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:07.595881 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-02abcec3-e389-4b0d-b6df-ce8422c318ac tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:07.603083 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-02abcec3-e389-4b0d-b6df-ce8422c318ac tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637" status: 200 len: 1312 microversion: 2.1 time: 0.155846 Feb 15 14:26:07.603641 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 155/298] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:07 2022] GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637 => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:08.292576 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-4568234e-9962-46cd-8828-00d9df4ed834 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:08.294985 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-4568234e-9962-46cd-8828-00d9df4ed834 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:08.304878 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4568234e-9962-46cd-8828-00d9df4ed834 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:08.305328 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4568234e-9962-46cd-8828-00d9df4ed834 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:08.306119 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4568234e-9962-46cd-8828-00d9df4ed834 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:08.306544 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4568234e-9962-46cd-8828-00d9df4ed834 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:08.323308 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-24a59558-081d-4f32-907b-710afc9fafb1 req-1b434499-0f5c-4d04-a95e-0c4242b8984b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a5da8f-7b06-4477-91dc-61ab6453e637", "name": "network-vif-plugged", "status": "completed", "tag": "7c6fea78-c836-4b6b-ace4-8c39c21bdb6f"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:26:08.325469 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:26:08.325469 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:26:08.333222 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-24a59558-081d-4f32-907b-710afc9fafb1 req-1b434499-0f5c-4d04-a95e-0c4242b8984b service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:08.333706 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-24a59558-081d-4f32-907b-710afc9fafb1 req-1b434499-0f5c-4d04-a95e-0c4242b8984b service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:08.342632 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-4568234e-9962-46cd-8828-00d9df4ed834 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054847 Feb 15 14:26:08.343214 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 144/299] 10.222.0.83 () {58 vars in 1301 bytes} [Tue Feb 15 14:26:08 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:26:08.350817 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-24a59558-081d-4f32-907b-710afc9fafb1 req-1b434499-0f5c-4d04-a95e-0c4242b8984b service nova] Creating event network-vif-plugged:7c6fea78-c836-4b6b-ace4-8c39c21bdb6f for instance 50a5da8f-7b06-4477-91dc-61ab6453e637 on hv-cinder-81914 Feb 15 14:26:08.355710 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-24a59558-081d-4f32-907b-710afc9fafb1 req-1b434499-0f5c-4d04-a95e-0c4242b8984b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036933 Feb 15 14:26:08.356858 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 156/300] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:26:08.376781 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-1c65b3fa-2679-4917-8a2f-b5200eeffcb7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:08.377485 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-1c65b3fa-2679-4917-8a2f-b5200eeffcb7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:08.384255 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1c65b3fa-2679-4917-8a2f-b5200eeffcb7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:08.384735 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1c65b3fa-2679-4917-8a2f-b5200eeffcb7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:08.385507 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1c65b3fa-2679-4917-8a2f-b5200eeffcb7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:08.385995 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1c65b3fa-2679-4917-8a2f-b5200eeffcb7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:08.529716 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-1c65b3fa-2679-4917-8a2f-b5200eeffcb7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:08.537325 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-1c65b3fa-2679-4917-8a2f-b5200eeffcb7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1521 microversion: 2.1 time: 0.166014 Feb 15 14:26:08.542879 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 145/301] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:08 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:08.621608 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-8015b029-25bb-4b7b-8141-8da7aa1a99a8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:08.622583 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-8015b029-25bb-4b7b-8141-8da7aa1a99a8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:08.628664 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8015b029-25bb-4b7b-8141-8da7aa1a99a8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:08.629112 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8015b029-25bb-4b7b-8141-8da7aa1a99a8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:08.629880 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8015b029-25bb-4b7b-8141-8da7aa1a99a8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:08.630313 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8015b029-25bb-4b7b-8141-8da7aa1a99a8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:08.770932 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-8015b029-25bb-4b7b-8141-8da7aa1a99a8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:08.778162 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-8015b029-25bb-4b7b-8141-8da7aa1a99a8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637" status: 200 len: 1312 microversion: 2.1 time: 0.161139 Feb 15 14:26:08.778726 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 157/302] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:08 2022] GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637 => generated 1312 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:09.353294 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-22985d41-f7d0-4c04-ae85-8d4cc8c17402 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:09.354196 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-22985d41-f7d0-4c04-ae85-8d4cc8c17402 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:09.360395 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-22985d41-f7d0-4c04-ae85-8d4cc8c17402 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:09.360866 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-22985d41-f7d0-4c04-ae85-8d4cc8c17402 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:09.361628 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-22985d41-f7d0-4c04-ae85-8d4cc8c17402 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:09.362057 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-22985d41-f7d0-4c04-ae85-8d4cc8c17402 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:09.392008 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-22985d41-f7d0-4c04-ae85-8d4cc8c17402 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042379 Feb 15 14:26:09.392586 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 146/303] 10.222.0.83 () {58 vars in 1301 bytes} [Tue Feb 15 14:26:09 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 15 14:26:09.539897 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-0da6eab4-c855-4790-9481-e9ea16a36c5e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-278470056", "imageRef": "da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53", "flavorRef": "452", "networks": [{"uuid": "eff5572c-5ad3-47ef-8854-8018b7c6065d"}]}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:26:09.558514 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-858cd76d-13d0-4192-ac02-6a3bdc359da6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:09.559673 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-858cd76d-13d0-4192-ac02-6a3bdc359da6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:09.566346 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-858cd76d-13d0-4192-ac02-6a3bdc359da6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:09.566795 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-858cd76d-13d0-4192-ac02-6a3bdc359da6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:09.567581 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-858cd76d-13d0-4192-ac02-6a3bdc359da6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:09.568070 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-858cd76d-13d0-4192-ac02-6a3bdc359da6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:09.596246 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.network.neutron [None req-0da6eab4-c855-4790-9481-e9ea16a36c5e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] validate_networks() for [('eff5572c-5ad3-47ef-8854-8018b7c6065d', None, None, None, None, None)] {{(pid=116363) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 14:26:09.710869 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-858cd76d-13d0-4192-ac02-6a3bdc359da6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:09.719187 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-858cd76d-13d0-4192-ac02-6a3bdc359da6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1501 microversion: 2.1 time: 0.167339 Feb 15 14:26:09.719814 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 147/304] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:09 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1501 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:09.735706 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-18f43ed9-39b2-4eaa-bd40-1ee07ef68fec tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:09.736316 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-18f43ed9-39b2-4eaa-bd40-1ee07ef68fec tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:09.742277 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-18f43ed9-39b2-4eaa-bd40-1ee07ef68fec tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:09.742725 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-18f43ed9-39b2-4eaa-bd40-1ee07ef68fec tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:09.743503 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-18f43ed9-39b2-4eaa-bd40-1ee07ef68fec tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:09.743941 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-18f43ed9-39b2-4eaa-bd40-1ee07ef68fec tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:09.889579 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-18f43ed9-39b2-4eaa-bd40-1ee07ef68fec tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:09.897035 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-18f43ed9-39b2-4eaa-bd40-1ee07ef68fec tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1515 microversion: 2.1 time: 0.164933 Feb 15 14:26:09.897602 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 148/305] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:09 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:26:09.901953 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-524cae65-9866-4359-acb4-2d4752259fb6 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:09.902579 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-524cae65-9866-4359-acb4-2d4752259fb6 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:09.908872 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-524cae65-9866-4359-acb4-2d4752259fb6 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:09.909374 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-524cae65-9866-4359-acb4-2d4752259fb6 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:09.910396 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-524cae65-9866-4359-acb4-2d4752259fb6 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:09.911080 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-524cae65-9866-4359-acb4-2d4752259fb6 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:09.983172 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-0da6eab4-c855-4790-9481-e9ea16a36c5e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Flavor limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 14:26:09.984184 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-0da6eab4-c855-4790-9481-e9ea16a36c5e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Image limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 14:26:09.984732 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-0da6eab4-c855-4790-9481-e9ea16a36c5e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Flavor pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 14:26:09.985239 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-0da6eab4-c855-4790-9481-e9ea16a36c5e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Image pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 14:26:09.985515 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-0da6eab4-c855-4790-9481-e9ea16a36c5e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 14:26:09.995653 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0da6eab4-c855-4790-9481-e9ea16a36c5e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:09.996382 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0da6eab4-c855-4790-9481-e9ea16a36c5e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:09.997392 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0da6eab4-c855-4790-9481-e9ea16a36c5e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:09.997828 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0da6eab4-c855-4790-9481-e9ea16a36c5e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:10.017651 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-0da6eab4-c855-4790-9481-e9ea16a36c5e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Getting quotas for project b003f1ecbf4e4a32a99159d5b18a98ec. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:26:10.022070 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-0da6eab4-c855-4790-9481-e9ea16a36c5e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Getting quotas for user 9b50593d13054c9c8fdf463566f36b2e and project b003f1ecbf4e4a32a99159d5b18a98ec. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:26:10.040986 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-0da6eab4-c855-4790-9481-e9ea16a36c5e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Going to run 1 instances... {{(pid=116363) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 14:26:10.043623 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-0da6eab4-c855-4790-9481-e9ea16a36c5e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 14:26:10.066833 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-524cae65-9866-4359-acb4-2d4752259fb6 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:10.076492 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-524cae65-9866-4359-acb4-2d4752259fb6 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637" status: 200 len: 1312 microversion: 2.1 time: 0.177716 Feb 15 14:26:10.077656 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 149/306] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:09 2022] GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637 => generated 1312 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:10.093341 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-0da6eab4-c855-4790-9481-e9ea16a36c5e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557162 Feb 15 14:26:10.094202 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 158/307] 10.222.0.83 () {60 vars in 1146 bytes} [Tue Feb 15 14:26:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 14:26:10.103492 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-22f9fe11-0d36-404b-b8bd-1eaaab0c3143 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:10.104253 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-22f9fe11-0d36-404b-b8bd-1eaaab0c3143 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:10.171321 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-22f9fe11-0d36-404b-b8bd-1eaaab0c3143 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:10.180002 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-22f9fe11-0d36-404b-b8bd-1eaaab0c3143 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 200 len: 1217 microversion: 2.1 time: 0.080088 Feb 15 14:26:10.190101 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 150/308] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:10 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:11.093591 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-bf366b1b-4a35-43a1-8192-629fb17a1bfe tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:11.094212 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-bf366b1b-4a35-43a1-8192-629fb17a1bfe tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:11.101022 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bf366b1b-4a35-43a1-8192-629fb17a1bfe tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:11.101491 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bf366b1b-4a35-43a1-8192-629fb17a1bfe tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:11.103173 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bf366b1b-4a35-43a1-8192-629fb17a1bfe tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:11.103658 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bf366b1b-4a35-43a1-8192-629fb17a1bfe tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:11.197265 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-17c4a9ec-3d05-4472-b69e-df6bad9aa2a4 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:11.197869 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-17c4a9ec-3d05-4472-b69e-df6bad9aa2a4 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:11.212516 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-17c4a9ec-3d05-4472-b69e-df6bad9aa2a4 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:11.213006 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-17c4a9ec-3d05-4472-b69e-df6bad9aa2a4 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:11.213860 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-17c4a9ec-3d05-4472-b69e-df6bad9aa2a4 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:11.214314 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-17c4a9ec-3d05-4472-b69e-df6bad9aa2a4 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:11.246852 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-bf366b1b-4a35-43a1-8192-629fb17a1bfe tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:11.254373 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-bf366b1b-4a35-43a1-8192-629fb17a1bfe tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637" status: 200 len: 1495 microversion: 2.1 time: 0.164860 Feb 15 14:26:11.254958 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 159/309] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:11 2022] GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637 => generated 1495 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:11.277513 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-17c4a9ec-3d05-4472-b69e-df6bad9aa2a4 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:11.287291 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-17c4a9ec-3d05-4472-b69e-df6bad9aa2a4 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 200 len: 1269 microversion: 2.1 time: 0.093555 Feb 15 14:26:11.288085 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 151/310] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:11 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 1269 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:26:11.300589 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-0a0f503b-f199-4fd9-9c6c-57ef69e886a2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:26:11.301606 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-0a0f503b-f199-4fd9-9c6c-57ef69e886a2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:11.307434 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0a0f503b-f199-4fd9-9c6c-57ef69e886a2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:11.307883 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0a0f503b-f199-4fd9-9c6c-57ef69e886a2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:11.308694 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0a0f503b-f199-4fd9-9c6c-57ef69e886a2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:11.309208 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0a0f503b-f199-4fd9-9c6c-57ef69e886a2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:11.332312 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.objects.instance [None req-0a0f503b-f199-4fd9-9c6c-57ef69e886a2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lazy-loading 'flavor' on Instance uuid 13edf4fd-20da-43ce-bb58-5757dc0f96c7 {{(pid=116363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:26:11.440175 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-0a0f503b-f199-4fd9-9c6c-57ef69e886a2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "POST /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/action" status: 200 len: 32 microversion: 2.1 time: 0.143100 Feb 15 14:26:11.440759 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 160/311] 10.222.0.83 () {60 vars in 1277 bytes} [Tue Feb 15 14:26:11 2022] POST /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/action => generated 32 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 14:26:11.450073 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-cdd14130-56f1-4e25-9e13-ad10f74f2f3f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:11.450811 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-cdd14130-56f1-4e25-9e13-ad10f74f2f3f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:11.456664 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cdd14130-56f1-4e25-9e13-ad10f74f2f3f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:11.457114 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cdd14130-56f1-4e25-9e13-ad10f74f2f3f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:11.457886 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cdd14130-56f1-4e25-9e13-ad10f74f2f3f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:11.458324 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cdd14130-56f1-4e25-9e13-ad10f74f2f3f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:11.653281 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-cdd14130-56f1-4e25-9e13-ad10f74f2f3f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:11.665536 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-cdd14130-56f1-4e25-9e13-ad10f74f2f3f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.219578 Feb 15 14:26:11.675253 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 152/312] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:11 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:26:12.170811 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-238f26bb-8296-4da8-a8a5-c18204ab8ba7 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:12.171407 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-238f26bb-8296-4da8-a8a5-c18204ab8ba7 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:12.178043 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-238f26bb-8296-4da8-a8a5-c18204ab8ba7 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:12.178498 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-238f26bb-8296-4da8-a8a5-c18204ab8ba7 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:12.179278 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-238f26bb-8296-4da8-a8a5-c18204ab8ba7 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:12.179718 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-238f26bb-8296-4da8-a8a5-c18204ab8ba7 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:12.207852 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-238f26bb-8296-4da8-a8a5-c18204ab8ba7 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] Going to try to terminate instance {{(pid=116363) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 14:26:12.305389 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-aeea3fed-7cec-499a-b587-3d030f2ad2a0 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:12.306825 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-aeea3fed-7cec-499a-b587-3d030f2ad2a0 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:12.310456 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-238f26bb-8296-4da8-a8a5-c18204ab8ba7 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "DELETE /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637" status: 204 len: 0 microversion: 2.1 time: 0.142385 Feb 15 14:26:12.311787 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 161/313] 10.222.0.83 () {58 vars in 1238 bytes} [Tue Feb 15 14:26:12 2022] DELETE /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 14:26:12.321760 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-f5e680a7-3795-4eb6-a0c5-ee865fda6e66 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:12.322986 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-aeea3fed-7cec-499a-b587-3d030f2ad2a0 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:12.323670 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-aeea3fed-7cec-499a-b587-3d030f2ad2a0 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:12.324317 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-f5e680a7-3795-4eb6-a0c5-ee865fda6e66 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:12.325503 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-aeea3fed-7cec-499a-b587-3d030f2ad2a0 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:12.326150 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-aeea3fed-7cec-499a-b587-3d030f2ad2a0 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:12.334955 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f5e680a7-3795-4eb6-a0c5-ee865fda6e66 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:12.336004 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f5e680a7-3795-4eb6-a0c5-ee865fda6e66 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:12.337391 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f5e680a7-3795-4eb6-a0c5-ee865fda6e66 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:12.338265 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f5e680a7-3795-4eb6-a0c5-ee865fda6e66 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:12.492546 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-aeea3fed-7cec-499a-b587-3d030f2ad2a0 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:12.503928 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-aeea3fed-7cec-499a-b587-3d030f2ad2a0 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 200 len: 1317 microversion: 2.1 time: 0.202279 Feb 15 14:26:12.512706 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 153/314] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:12 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:26:12.646274 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-f5e680a7-3795-4eb6-a0c5-ee865fda6e66 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:12.655188 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-f5e680a7-3795-4eb6-a0c5-ee865fda6e66 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637" status: 200 len: 1501 microversion: 2.1 time: 0.339250 Feb 15 14:26:12.655772 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 162/315] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:12 2022] GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637 => generated 1501 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:12.682718 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-0b46a823-913c-4a8e-bc7d-9fcf32ce83bd tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:12.683323 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-0b46a823-913c-4a8e-bc7d-9fcf32ce83bd tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:12.689770 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0b46a823-913c-4a8e-bc7d-9fcf32ce83bd tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:12.690219 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0b46a823-913c-4a8e-bc7d-9fcf32ce83bd tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:12.690985 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0b46a823-913c-4a8e-bc7d-9fcf32ce83bd tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:12.691415 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0b46a823-913c-4a8e-bc7d-9fcf32ce83bd tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:12.834025 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-0b46a823-913c-4a8e-bc7d-9fcf32ce83bd tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:12.842246 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-0b46a823-913c-4a8e-bc7d-9fcf32ce83bd tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.163149 Feb 15 14:26:12.843103 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 154/316] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:12 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:13.078489 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-a158f7a4-9ecc-4895-ba69-635146f83359 req-27021968-4541-493d-bf49-f2dc948f2a2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "227a84d4-a09c-4a38-8cdf-f3ddb59bf18c", "tag": "d7c8d0a9-8af0-4fae-9a63-dc7141d6f1c9"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:26:13.080121 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:26:13.080121 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:26:13.088294 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-a158f7a4-9ecc-4895-ba69-635146f83359 req-27021968-4541-493d-bf49-f2dc948f2a2d service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:13.088782 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-a158f7a4-9ecc-4895-ba69-635146f83359 req-27021968-4541-493d-bf49-f2dc948f2a2d service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:13.108009 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-a158f7a4-9ecc-4895-ba69-635146f83359 req-27021968-4541-493d-bf49-f2dc948f2a2d service nova] Creating event network-changed:d7c8d0a9-8af0-4fae-9a63-dc7141d6f1c9 for instance 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c on hv-cinder-81914 Feb 15 14:26:13.112542 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-a158f7a4-9ecc-4895-ba69-635146f83359 req-27021968-4541-493d-bf49-f2dc948f2a2d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038752 Feb 15 14:26:13.113143 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 163/317] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:26:13.521259 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-839f440d-f04b-4c2f-89ed-b7f119024d62 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:13.521806 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-839f440d-f04b-4c2f-89ed-b7f119024d62 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:13.528998 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-839f440d-f04b-4c2f-89ed-b7f119024d62 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:13.529485 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-839f440d-f04b-4c2f-89ed-b7f119024d62 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:13.530354 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-839f440d-f04b-4c2f-89ed-b7f119024d62 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:13.531033 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-839f440d-f04b-4c2f-89ed-b7f119024d62 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:13.670757 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-839f440d-f04b-4c2f-89ed-b7f119024d62 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:13.674406 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-2721d334-3821-4608-ba3e-42bbd7be9bc3 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:13.674898 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-2721d334-3821-4608-ba3e-42bbd7be9bc3 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:13.678484 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-839f440d-f04b-4c2f-89ed-b7f119024d62 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 200 len: 1317 microversion: 2.1 time: 0.160899 Feb 15 14:26:13.680590 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2721d334-3821-4608-ba3e-42bbd7be9bc3 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:13.681049 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2721d334-3821-4608-ba3e-42bbd7be9bc3 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:13.681934 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2721d334-3821-4608-ba3e-42bbd7be9bc3 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:13.682281 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2721d334-3821-4608-ba3e-42bbd7be9bc3 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:13.688573 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 155/318] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:13 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:13.861562 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-28f7c38e-df5b-44f3-b493-893df5634a65 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:13.862286 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-28f7c38e-df5b-44f3-b493-893df5634a65 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:13.868216 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-28f7c38e-df5b-44f3-b493-893df5634a65 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:13.868784 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-28f7c38e-df5b-44f3-b493-893df5634a65 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:13.869791 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-28f7c38e-df5b-44f3-b493-893df5634a65 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:13.870230 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-28f7c38e-df5b-44f3-b493-893df5634a65 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:14.010615 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-28f7c38e-df5b-44f3-b493-893df5634a65 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:14.019302 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-28f7c38e-df5b-44f3-b493-893df5634a65 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.161265 Feb 15 14:26:14.019897 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 156/319] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:13 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:14.134839 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-2721d334-3821-4608-ba3e-42bbd7be9bc3 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:14.142456 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-2721d334-3821-4608-ba3e-42bbd7be9bc3 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637" status: 200 len: 1501 microversion: 2.1 time: 0.473091 Feb 15 14:26:14.143048 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 164/320] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:13 2022] GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637 => generated 1501 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:26:14.695835 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-865c157e-9efb-4a0a-9abf-6c427fd032f5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:14.696451 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-865c157e-9efb-4a0a-9abf-6c427fd032f5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:14.702751 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-865c157e-9efb-4a0a-9abf-6c427fd032f5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:14.703196 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-865c157e-9efb-4a0a-9abf-6c427fd032f5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:14.703951 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-865c157e-9efb-4a0a-9abf-6c427fd032f5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:14.704378 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-865c157e-9efb-4a0a-9abf-6c427fd032f5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:14.835491 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-865c157e-9efb-4a0a-9abf-6c427fd032f5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:14.843354 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-865c157e-9efb-4a0a-9abf-6c427fd032f5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 200 len: 1317 microversion: 2.1 time: 0.151138 Feb 15 14:26:14.843932 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 157/321] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:14 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:15.037003 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-d7023bc0-4e73-4c5a-8f18-c3487c7d1476 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:15.037512 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-d7023bc0-4e73-4c5a-8f18-c3487c7d1476 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:15.044463 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d7023bc0-4e73-4c5a-8f18-c3487c7d1476 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:15.044908 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d7023bc0-4e73-4c5a-8f18-c3487c7d1476 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:15.045674 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d7023bc0-4e73-4c5a-8f18-c3487c7d1476 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:15.046108 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d7023bc0-4e73-4c5a-8f18-c3487c7d1476 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:15.159306 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-ab7d892e-e6f6-4871-b56f-d45e5ad92ed3 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:15.159909 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-ab7d892e-e6f6-4871-b56f-d45e5ad92ed3 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:15.166228 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ab7d892e-e6f6-4871-b56f-d45e5ad92ed3 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:15.166826 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ab7d892e-e6f6-4871-b56f-d45e5ad92ed3 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:15.167576 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ab7d892e-e6f6-4871-b56f-d45e5ad92ed3 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:15.168039 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ab7d892e-e6f6-4871-b56f-d45e5ad92ed3 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:15.183306 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-d7023bc0-4e73-4c5a-8f18-c3487c7d1476 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:15.190646 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-d7023bc0-4e73-4c5a-8f18-c3487c7d1476 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.157612 Feb 15 14:26:15.191246 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 165/322] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:15 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:15.305126 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-ab7d892e-e6f6-4871-b56f-d45e5ad92ed3 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:15.312767 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-ab7d892e-e6f6-4871-b56f-d45e5ad92ed3 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637" status: 200 len: 1501 microversion: 2.1 time: 0.157077 Feb 15 14:26:15.313331 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 158/323] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:15 2022] GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637 => generated 1501 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:26:15.860650 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-736b7d13-6e65-4d65-8873-f40260ffbf01 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:15.860884 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-736b7d13-6e65-4d65-8873-f40260ffbf01 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:15.866749 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-736b7d13-6e65-4d65-8873-f40260ffbf01 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:15.867198 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-736b7d13-6e65-4d65-8873-f40260ffbf01 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:15.868153 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-736b7d13-6e65-4d65-8873-f40260ffbf01 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:15.868626 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-736b7d13-6e65-4d65-8873-f40260ffbf01 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:16.001123 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-736b7d13-6e65-4d65-8873-f40260ffbf01 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:16.008617 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-736b7d13-6e65-4d65-8873-f40260ffbf01 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 200 len: 1317 microversion: 2.1 time: 0.151970 Feb 15 14:26:16.009405 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 166/324] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:15 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:16.207998 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-e5fe6a05-d22a-40e3-95c5-45e74192cf9d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:16.208752 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-e5fe6a05-d22a-40e3-95c5-45e74192cf9d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:16.215484 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e5fe6a05-d22a-40e3-95c5-45e74192cf9d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:16.216320 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e5fe6a05-d22a-40e3-95c5-45e74192cf9d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:16.217223 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e5fe6a05-d22a-40e3-95c5-45e74192cf9d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:16.217724 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e5fe6a05-d22a-40e3-95c5-45e74192cf9d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:16.329804 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-baccf077-5d17-484b-95e9-8119362c1ba8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:16.330990 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-baccf077-5d17-484b-95e9-8119362c1ba8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:16.337908 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-baccf077-5d17-484b-95e9-8119362c1ba8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:16.338468 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-baccf077-5d17-484b-95e9-8119362c1ba8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:16.339366 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-baccf077-5d17-484b-95e9-8119362c1ba8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:16.340466 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-baccf077-5d17-484b-95e9-8119362c1ba8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:16.353274 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-e5fe6a05-d22a-40e3-95c5-45e74192cf9d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:16.361696 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-e5fe6a05-d22a-40e3-95c5-45e74192cf9d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.157267 Feb 15 14:26:16.362551 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 159/325] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:16 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:16.540063 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-baccf077-5d17-484b-95e9-8119362c1ba8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:16.548126 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-baccf077-5d17-484b-95e9-8119362c1ba8 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637" status: 200 len: 1501 microversion: 2.1 time: 0.222004 Feb 15 14:26:16.548730 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 167/326] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:16 2022] GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637 => generated 1501 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:26:16.686543 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-e530f503-9d89-406c-9c56-1c0fd18a4d04 req-ce78b673-7fbb-4ae0-8215-dc6edb890543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a5da8f-7b06-4477-91dc-61ab6453e637", "name": "network-vif-deleted", "tag": "7c6fea78-c836-4b6b-ace4-8c39c21bdb6f"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:26:16.688114 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:26:16.688114 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:26:16.694922 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-e530f503-9d89-406c-9c56-1c0fd18a4d04 req-ce78b673-7fbb-4ae0-8215-dc6edb890543 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:16.695359 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-e530f503-9d89-406c-9c56-1c0fd18a4d04 req-ce78b673-7fbb-4ae0-8215-dc6edb890543 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:16.706567 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-e530f503-9d89-406c-9c56-1c0fd18a4d04 req-ce78b673-7fbb-4ae0-8215-dc6edb890543 service nova] Creating event network-vif-deleted:7c6fea78-c836-4b6b-ace4-8c39c21bdb6f for instance 50a5da8f-7b06-4477-91dc-61ab6453e637 on hv-cinder-81914 Feb 15 14:26:16.711703 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-e530f503-9d89-406c-9c56-1c0fd18a4d04 req-ce78b673-7fbb-4ae0-8215-dc6edb890543 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029159 Feb 15 14:26:16.712286 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 160/327] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:26:17.025351 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-a0040792-3685-4f24-8ffe-723a3273240f tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:17.025949 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-a0040792-3685-4f24-8ffe-723a3273240f tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:17.031894 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a0040792-3685-4f24-8ffe-723a3273240f tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:17.032333 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a0040792-3685-4f24-8ffe-723a3273240f tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:17.033126 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a0040792-3685-4f24-8ffe-723a3273240f tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:17.033555 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a0040792-3685-4f24-8ffe-723a3273240f tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:17.171219 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a0040792-3685-4f24-8ffe-723a3273240f tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:17.178595 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-a0040792-3685-4f24-8ffe-723a3273240f tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 200 len: 1317 microversion: 2.1 time: 0.156873 Feb 15 14:26:17.179159 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 168/328] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:17 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:17.378615 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-39db48f6-76f3-42de-8620-602cd98d6c51 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:17.379316 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-39db48f6-76f3-42de-8620-602cd98d6c51 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:17.385845 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-39db48f6-76f3-42de-8620-602cd98d6c51 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:17.386297 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-39db48f6-76f3-42de-8620-602cd98d6c51 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:17.387071 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-39db48f6-76f3-42de-8620-602cd98d6c51 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:17.387595 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-39db48f6-76f3-42de-8620-602cd98d6c51 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:17.526914 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-39db48f6-76f3-42de-8620-602cd98d6c51 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:17.534261 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-39db48f6-76f3-42de-8620-602cd98d6c51 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.159693 Feb 15 14:26:17.534825 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 161/329] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:17 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:17.565271 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-7232e114-64a0-4eaf-a4d6-cb70cbeaec87 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:17.565881 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-7232e114-64a0-4eaf-a4d6-cb70cbeaec87 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:17.572206 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7232e114-64a0-4eaf-a4d6-cb70cbeaec87 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:17.572699 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7232e114-64a0-4eaf-a4d6-cb70cbeaec87 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:17.573473 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7232e114-64a0-4eaf-a4d6-cb70cbeaec87 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:17.573911 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7232e114-64a0-4eaf-a4d6-cb70cbeaec87 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:17.634148 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-7232e114-64a0-4eaf-a4d6-cb70cbeaec87 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:17.641803 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-7232e114-64a0-4eaf-a4d6-cb70cbeaec87 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637" status: 200 len: 1297 microversion: 2.1 time: 0.080102 Feb 15 14:26:17.642368 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 169/330] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:17 2022] GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637 => generated 1297 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:18.196136 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-39e5fb16-2b79-462a-9db5-f10eefd741e8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:18.196711 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-39e5fb16-2b79-462a-9db5-f10eefd741e8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:18.203215 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-39e5fb16-2b79-462a-9db5-f10eefd741e8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:18.203663 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-39e5fb16-2b79-462a-9db5-f10eefd741e8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:18.204463 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-39e5fb16-2b79-462a-9db5-f10eefd741e8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:18.204903 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-39e5fb16-2b79-462a-9db5-f10eefd741e8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:18.335910 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-39e5fb16-2b79-462a-9db5-f10eefd741e8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:18.343721 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-39e5fb16-2b79-462a-9db5-f10eefd741e8 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 200 len: 1317 microversion: 2.1 time: 0.151363 Feb 15 14:26:18.344293 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 162/331] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:18 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:18.552036 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-bbd55358-9030-4f2d-8dc5-1fc608dd0639 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:18.552585 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-bbd55358-9030-4f2d-8dc5-1fc608dd0639 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:18.559006 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bbd55358-9030-4f2d-8dc5-1fc608dd0639 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:18.559459 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bbd55358-9030-4f2d-8dc5-1fc608dd0639 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:18.560228 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bbd55358-9030-4f2d-8dc5-1fc608dd0639 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:18.560686 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bbd55358-9030-4f2d-8dc5-1fc608dd0639 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:18.658344 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-13a1dc1f-074f-4d3e-9ab0-894330a9795e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:18.659137 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-13a1dc1f-074f-4d3e-9ab0-894330a9795e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:18.665604 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-13a1dc1f-074f-4d3e-9ab0-894330a9795e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:18.666058 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-13a1dc1f-074f-4d3e-9ab0-894330a9795e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:18.666834 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-13a1dc1f-074f-4d3e-9ab0-894330a9795e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:18.667394 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-13a1dc1f-074f-4d3e-9ab0-894330a9795e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:18.695778 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-bbd55358-9030-4f2d-8dc5-1fc608dd0639 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:18.706355 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-bbd55358-9030-4f2d-8dc5-1fc608dd0639 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.157892 Feb 15 14:26:18.709624 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 170/332] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:18 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:18.738379 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-13a1dc1f-074f-4d3e-9ab0-894330a9795e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:18.745754 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-13a1dc1f-074f-4d3e-9ab0-894330a9795e tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637" status: 200 len: 1297 microversion: 2.1 time: 0.091160 Feb 15 14:26:18.746818 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 163/333] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:18 2022] GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637 => generated 1297 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:26:19.360778 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-bd0f1410-a6c9-4b03-851b-173d4290f536 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:19.361417 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-bd0f1410-a6c9-4b03-851b-173d4290f536 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:19.367287 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bd0f1410-a6c9-4b03-851b-173d4290f536 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:19.367726 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bd0f1410-a6c9-4b03-851b-173d4290f536 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:19.368512 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bd0f1410-a6c9-4b03-851b-173d4290f536 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:19.368940 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bd0f1410-a6c9-4b03-851b-173d4290f536 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:19.507293 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-bd0f1410-a6c9-4b03-851b-173d4290f536 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:19.514903 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-bd0f1410-a6c9-4b03-851b-173d4290f536 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 200 len: 1317 microversion: 2.1 time: 0.157543 Feb 15 14:26:19.524471 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 171/334] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:19 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:19.723720 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-4a3b00c9-2bfe-4d2f-b565-398e29fb634a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:19.724248 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-4a3b00c9-2bfe-4d2f-b565-398e29fb634a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:19.730719 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4a3b00c9-2bfe-4d2f-b565-398e29fb634a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:19.731174 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4a3b00c9-2bfe-4d2f-b565-398e29fb634a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:19.731945 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4a3b00c9-2bfe-4d2f-b565-398e29fb634a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:19.732375 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4a3b00c9-2bfe-4d2f-b565-398e29fb634a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:19.763353 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-dbd46432-ac2d-4685-ae08-d5326cf67291 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:19.763968 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-dbd46432-ac2d-4685-ae08-d5326cf67291 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:19.770274 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dbd46432-ac2d-4685-ae08-d5326cf67291 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:19.770754 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dbd46432-ac2d-4685-ae08-d5326cf67291 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:19.771568 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dbd46432-ac2d-4685-ae08-d5326cf67291 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:19.772008 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dbd46432-ac2d-4685-ae08-d5326cf67291 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:19.836067 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-dbd46432-ac2d-4685-ae08-d5326cf67291 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23066575a3f64880a5106edf8004f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2b25b171d84f23bca58cdb0eb675c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:19.845068 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-dbd46432-ac2d-4685-ae08-d5326cf67291 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637" status: 200 len: 1297 microversion: 2.1 time: 0.085789 Feb 15 14:26:19.845741 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 172/335] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:19 2022] GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:26:19.891457 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-4a3b00c9-2bfe-4d2f-b565-398e29fb634a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:19.898923 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-4a3b00c9-2bfe-4d2f-b565-398e29fb634a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.178897 Feb 15 14:26:19.899496 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 164/336] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:19 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:20.532370 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-8aaf0001-f7ab-43a9-bc26-3d079952ac62 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:20.532995 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-8aaf0001-f7ab-43a9-bc26-3d079952ac62 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:20.539034 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8aaf0001-f7ab-43a9-bc26-3d079952ac62 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:20.539471 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8aaf0001-f7ab-43a9-bc26-3d079952ac62 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:20.540234 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8aaf0001-f7ab-43a9-bc26-3d079952ac62 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:20.540698 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8aaf0001-f7ab-43a9-bc26-3d079952ac62 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:20.682406 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-8aaf0001-f7ab-43a9-bc26-3d079952ac62 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:20.689733 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-8aaf0001-f7ab-43a9-bc26-3d079952ac62 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 200 len: 1317 microversion: 2.1 time: 0.160955 Feb 15 14:26:20.690313 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 173/337] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:20 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:20.861468 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-123b2878-018c-4fa5-b9d6-1decd34db039 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:20.862178 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-123b2878-018c-4fa5-b9d6-1decd34db039 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] [instance: 50a5da8f-7b06-4477-91dc-61ab6453e637] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:20.868521 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-123b2878-018c-4fa5-b9d6-1decd34db039 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:20.868971 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-123b2878-018c-4fa5-b9d6-1decd34db039 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:20.869770 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-123b2878-018c-4fa5-b9d6-1decd34db039 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:20.870203 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-123b2878-018c-4fa5-b9d6-1decd34db039 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:20.885145 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.wsgi [None req-123b2878-018c-4fa5-b9d6-1decd34db039 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] HTTP exception thrown: Instance 50a5da8f-7b06-4477-91dc-61ab6453e637 could not be found. Feb 15 14:26:20.885869 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-123b2878-018c-4fa5-b9d6-1decd34db039 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] Returning 404 to user: Instance 50a5da8f-7b06-4477-91dc-61ab6453e637 could not be found. {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:26:20.887338 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-123b2878-018c-4fa5-b9d6-1decd34db039 tempest-VolumesActionsTest-1844786901 tempest-VolumesActionsTest-1844786901-project] 10.222.0.83 "GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637" status: 404 len: 111 microversion: 2.1 time: 0.028882 Feb 15 14:26:20.887883 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 165/338] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:20 2022] GET /compute/v2.1/servers/50a5da8f-7b06-4477-91dc-61ab6453e637 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:26:20.916986 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-8af13326-aa00-4d23-ad73-0255e6d7c619 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:20.917600 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-8af13326-aa00-4d23-ad73-0255e6d7c619 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:20.925794 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8af13326-aa00-4d23-ad73-0255e6d7c619 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:20.926511 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8af13326-aa00-4d23-ad73-0255e6d7c619 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:20.927300 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8af13326-aa00-4d23-ad73-0255e6d7c619 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:20.927610 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8af13326-aa00-4d23-ad73-0255e6d7c619 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:21.085979 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-8af13326-aa00-4d23-ad73-0255e6d7c619 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:21.098671 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-8af13326-aa00-4d23-ad73-0255e6d7c619 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.182377 Feb 15 14:26:21.098671 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 174/339] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:20 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:21.707945 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-24955332-f289-4838-8b1d-05c1e2eb8a06 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:21.709917 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-24955332-f289-4838-8b1d-05c1e2eb8a06 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:21.718720 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-24955332-f289-4838-8b1d-05c1e2eb8a06 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:21.719159 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-24955332-f289-4838-8b1d-05c1e2eb8a06 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:21.719972 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-24955332-f289-4838-8b1d-05c1e2eb8a06 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:21.720426 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-24955332-f289-4838-8b1d-05c1e2eb8a06 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:21.891793 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-24955332-f289-4838-8b1d-05c1e2eb8a06 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:21.899630 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-24955332-f289-4838-8b1d-05c1e2eb8a06 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 200 len: 1317 microversion: 2.1 time: 0.196191 Feb 15 14:26:21.900727 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 166/340] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:21 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:22.116628 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-ab18e0a6-a303-4149-a619-44cf4559e7a0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:22.117242 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-ab18e0a6-a303-4149-a619-44cf4559e7a0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:22.124719 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ab18e0a6-a303-4149-a619-44cf4559e7a0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:22.125173 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ab18e0a6-a303-4149-a619-44cf4559e7a0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:22.125946 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ab18e0a6-a303-4149-a619-44cf4559e7a0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:22.126541 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ab18e0a6-a303-4149-a619-44cf4559e7a0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:22.337385 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-ab18e0a6-a303-4149-a619-44cf4559e7a0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:22.346100 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-ab18e0a6-a303-4149-a619-44cf4559e7a0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.233080 Feb 15 14:26:22.346680 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 175/341] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:22 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:22.917193 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-a402b8e8-a89d-41ca-a4ab-4ed57caff0f5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:22.918024 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-a402b8e8-a89d-41ca-a4ab-4ed57caff0f5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:22.924455 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a402b8e8-a89d-41ca-a4ab-4ed57caff0f5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:22.924916 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a402b8e8-a89d-41ca-a4ab-4ed57caff0f5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:22.925692 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a402b8e8-a89d-41ca-a4ab-4ed57caff0f5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:22.926127 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a402b8e8-a89d-41ca-a4ab-4ed57caff0f5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:23.063421 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-a402b8e8-a89d-41ca-a4ab-4ed57caff0f5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:23.071109 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-a402b8e8-a89d-41ca-a4ab-4ed57caff0f5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 200 len: 1317 microversion: 2.1 time: 0.157743 Feb 15 14:26:23.071660 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 167/342] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:22 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:23.363518 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-28199979-895c-477e-9f80-054e6fafec31 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:23.364268 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-28199979-895c-477e-9f80-054e6fafec31 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:23.370588 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-28199979-895c-477e-9f80-054e6fafec31 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:23.371929 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-28199979-895c-477e-9f80-054e6fafec31 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:23.372735 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-28199979-895c-477e-9f80-054e6fafec31 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:23.373174 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-28199979-895c-477e-9f80-054e6fafec31 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:23.505063 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-28199979-895c-477e-9f80-054e6fafec31 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:23.512806 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-28199979-895c-477e-9f80-054e6fafec31 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.152878 Feb 15 14:26:23.513624 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 176/343] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:23 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:24.088031 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-79a9a0d2-55b8-4af6-94b8-9b6e80fd7c82 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:24.088674 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-79a9a0d2-55b8-4af6-94b8-9b6e80fd7c82 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:24.095206 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-79a9a0d2-55b8-4af6-94b8-9b6e80fd7c82 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:24.095649 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-79a9a0d2-55b8-4af6-94b8-9b6e80fd7c82 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:24.096434 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-79a9a0d2-55b8-4af6-94b8-9b6e80fd7c82 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:24.096866 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-79a9a0d2-55b8-4af6-94b8-9b6e80fd7c82 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:24.226761 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-79a9a0d2-55b8-4af6-94b8-9b6e80fd7c82 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:24.234969 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-79a9a0d2-55b8-4af6-94b8-9b6e80fd7c82 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 200 len: 1317 microversion: 2.1 time: 0.150590 Feb 15 14:26:24.235542 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 168/344] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:24 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:24.529352 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-2d62beb0-e832-4ef2-861b-559a02c300ff tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:24.529984 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-2d62beb0-e832-4ef2-861b-559a02c300ff tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:24.536057 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2d62beb0-e832-4ef2-861b-559a02c300ff tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:24.536822 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2d62beb0-e832-4ef2-861b-559a02c300ff tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:24.537587 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2d62beb0-e832-4ef2-861b-559a02c300ff tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:24.538016 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2d62beb0-e832-4ef2-861b-559a02c300ff tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:24.674512 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-2d62beb0-e832-4ef2-861b-559a02c300ff tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:24.681687 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-2d62beb0-e832-4ef2-861b-559a02c300ff tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.156364 Feb 15 14:26:24.682245 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 177/345] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:24 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:25.251884 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-42792b5c-c1ea-4dba-bfae-5c76e89de595 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:25.252393 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-42792b5c-c1ea-4dba-bfae-5c76e89de595 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:25.258369 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-42792b5c-c1ea-4dba-bfae-5c76e89de595 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:25.258821 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-42792b5c-c1ea-4dba-bfae-5c76e89de595 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:25.259602 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-42792b5c-c1ea-4dba-bfae-5c76e89de595 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:25.260043 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-42792b5c-c1ea-4dba-bfae-5c76e89de595 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:25.396162 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-42792b5c-c1ea-4dba-bfae-5c76e89de595 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:25.404208 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-42792b5c-c1ea-4dba-bfae-5c76e89de595 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 200 len: 1317 microversion: 2.1 time: 0.156185 Feb 15 14:26:25.404780 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 169/346] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:25 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:25.698168 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-6b377b45-5efe-4197-8253-6d5bbe8d0024 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:25.699322 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-6b377b45-5efe-4197-8253-6d5bbe8d0024 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:25.705563 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6b377b45-5efe-4197-8253-6d5bbe8d0024 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:25.706012 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6b377b45-5efe-4197-8253-6d5bbe8d0024 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:25.706782 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6b377b45-5efe-4197-8253-6d5bbe8d0024 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:25.707211 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6b377b45-5efe-4197-8253-6d5bbe8d0024 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:25.847150 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-6b377b45-5efe-4197-8253-6d5bbe8d0024 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:25.854366 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-6b377b45-5efe-4197-8253-6d5bbe8d0024 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.159914 Feb 15 14:26:25.855000 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 178/347] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:25 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:26.421396 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-8e73c7ad-27e8-4cdd-890e-6defe0387d37 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:26.422005 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-8e73c7ad-27e8-4cdd-890e-6defe0387d37 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:26.428246 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8e73c7ad-27e8-4cdd-890e-6defe0387d37 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:26.428737 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8e73c7ad-27e8-4cdd-890e-6defe0387d37 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:26.429518 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8e73c7ad-27e8-4cdd-890e-6defe0387d37 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:26.429957 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8e73c7ad-27e8-4cdd-890e-6defe0387d37 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:26.568420 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-8e73c7ad-27e8-4cdd-890e-6defe0387d37 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:26.576106 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-8e73c7ad-27e8-4cdd-890e-6defe0387d37 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 200 len: 1317 microversion: 2.1 time: 0.158790 Feb 15 14:26:26.576719 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 170/348] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:26 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:26.871001 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-9cf6b742-206d-4e46-89d5-0a6ee836ded2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:26.871729 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-9cf6b742-206d-4e46-89d5-0a6ee836ded2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:26.878249 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9cf6b742-206d-4e46-89d5-0a6ee836ded2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:26.878708 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9cf6b742-206d-4e46-89d5-0a6ee836ded2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:26.879493 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9cf6b742-206d-4e46-89d5-0a6ee836ded2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:26.879930 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9cf6b742-206d-4e46-89d5-0a6ee836ded2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:27.015826 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-9cf6b742-206d-4e46-89d5-0a6ee836ded2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:27.023362 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-9cf6b742-206d-4e46-89d5-0a6ee836ded2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.156079 Feb 15 14:26:27.023936 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 179/349] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:26 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:27.592114 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-f35a23b2-e81e-4816-a663-d3159570f7cb tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:27.592746 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-f35a23b2-e81e-4816-a663-d3159570f7cb tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:27.599000 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f35a23b2-e81e-4816-a663-d3159570f7cb tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:27.599445 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f35a23b2-e81e-4816-a663-d3159570f7cb tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:27.600214 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f35a23b2-e81e-4816-a663-d3159570f7cb tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:27.600689 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f35a23b2-e81e-4816-a663-d3159570f7cb tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:27.731003 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-f35a23b2-e81e-4816-a663-d3159570f7cb tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:27.738142 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-f35a23b2-e81e-4816-a663-d3159570f7cb tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 200 len: 1317 microversion: 2.1 time: 0.149642 Feb 15 14:26:27.738692 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 171/350] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:27 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:28.041481 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-17215f4b-146e-48b9-8f87-86487e7c2a4c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:28.042020 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-17215f4b-146e-48b9-8f87-86487e7c2a4c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:28.049088 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-17215f4b-146e-48b9-8f87-86487e7c2a4c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:28.049538 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-17215f4b-146e-48b9-8f87-86487e7c2a4c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:28.050313 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-17215f4b-146e-48b9-8f87-86487e7c2a4c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:28.050750 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-17215f4b-146e-48b9-8f87-86487e7c2a4c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:28.180802 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-17215f4b-146e-48b9-8f87-86487e7c2a4c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:28.189180 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-17215f4b-146e-48b9-8f87-86487e7c2a4c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.151489 Feb 15 14:26:28.189754 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 180/351] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:28 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:28.755688 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-57c5343a-bd82-4c97-8b3b-85d150945721 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:28.756313 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-57c5343a-bd82-4c97-8b3b-85d150945721 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:28.763116 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-57c5343a-bd82-4c97-8b3b-85d150945721 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:28.763552 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-57c5343a-bd82-4c97-8b3b-85d150945721 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:28.764314 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-57c5343a-bd82-4c97-8b3b-85d150945721 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:28.764776 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-57c5343a-bd82-4c97-8b3b-85d150945721 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:28.905311 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-57c5343a-bd82-4c97-8b3b-85d150945721 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:28.912821 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-57c5343a-bd82-4c97-8b3b-85d150945721 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 200 len: 1317 microversion: 2.1 time: 0.160699 Feb 15 14:26:28.913394 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 172/352] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:28 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:29.012657 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-b610094f-612e-458f-ae9c-4db6410243c3 req-0b710275-9f8e-492a-a07b-685cad13034b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "227a84d4-a09c-4a38-8cdf-f3ddb59bf18c", "name": "network-vif-plugged", "status": "completed", "tag": "d7c8d0a9-8af0-4fae-9a63-dc7141d6f1c9"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:26:29.014682 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:26:29.014682 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:26:29.022846 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-b610094f-612e-458f-ae9c-4db6410243c3 req-0b710275-9f8e-492a-a07b-685cad13034b service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:29.023303 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-b610094f-612e-458f-ae9c-4db6410243c3 req-0b710275-9f8e-492a-a07b-685cad13034b service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:29.034498 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-b610094f-612e-458f-ae9c-4db6410243c3 req-0b710275-9f8e-492a-a07b-685cad13034b service nova] Creating event network-vif-plugged:d7c8d0a9-8af0-4fae-9a63-dc7141d6f1c9 for instance 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c on hv-cinder-81914 Feb 15 14:26:29.039765 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-b610094f-612e-458f-ae9c-4db6410243c3 req-0b710275-9f8e-492a-a07b-685cad13034b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032176 Feb 15 14:26:29.040358 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 181/353] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:26:29.205991 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-8a903055-57ee-43a3-8cb8-fdba713ee467 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:29.206597 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-8a903055-57ee-43a3-8cb8-fdba713ee467 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:29.215261 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8a903055-57ee-43a3-8cb8-fdba713ee467 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:29.215932 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8a903055-57ee-43a3-8cb8-fdba713ee467 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:29.216750 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8a903055-57ee-43a3-8cb8-fdba713ee467 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:29.217296 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8a903055-57ee-43a3-8cb8-fdba713ee467 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:29.368612 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-8a903055-57ee-43a3-8cb8-fdba713ee467 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:29.376967 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-8a903055-57ee-43a3-8cb8-fdba713ee467 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.174464 Feb 15 14:26:29.377940 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 173/354] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:29 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:29.930780 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-999227ef-6c31-4f8b-a638-891ddc86d70c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:29.931574 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-999227ef-6c31-4f8b-a638-891ddc86d70c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:29.938321 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-999227ef-6c31-4f8b-a638-891ddc86d70c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:29.938901 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-999227ef-6c31-4f8b-a638-891ddc86d70c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:29.939886 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-999227ef-6c31-4f8b-a638-891ddc86d70c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:29.940430 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-999227ef-6c31-4f8b-a638-891ddc86d70c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:30.087777 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-999227ef-6c31-4f8b-a638-891ddc86d70c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:30.096102 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-999227ef-6c31-4f8b-a638-891ddc86d70c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 200 len: 1317 microversion: 2.1 time: 0.169937 Feb 15 14:26:30.097263 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 182/355] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:29 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:30.395101 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-3204fe87-51d6-4814-a399-a203409d35a2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:30.395741 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-3204fe87-51d6-4814-a399-a203409d35a2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:30.403752 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3204fe87-51d6-4814-a399-a203409d35a2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:30.404196 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3204fe87-51d6-4814-a399-a203409d35a2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:30.405004 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3204fe87-51d6-4814-a399-a203409d35a2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:30.405439 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3204fe87-51d6-4814-a399-a203409d35a2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:30.553625 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-3204fe87-51d6-4814-a399-a203409d35a2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:30.561202 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-3204fe87-51d6-4814-a399-a203409d35a2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.169940 Feb 15 14:26:30.561775 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 174/356] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:30 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:31.113602 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-9dafd0a0-9975-4e38-b651-e38a3a1655bd tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:31.114207 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-9dafd0a0-9975-4e38-b651-e38a3a1655bd tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:31.121307 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9dafd0a0-9975-4e38-b651-e38a3a1655bd tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:31.121872 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9dafd0a0-9975-4e38-b651-e38a3a1655bd tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:31.122766 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9dafd0a0-9975-4e38-b651-e38a3a1655bd tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:31.123196 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9dafd0a0-9975-4e38-b651-e38a3a1655bd tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:31.259549 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-9dafd0a0-9975-4e38-b651-e38a3a1655bd tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:31.266830 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-9dafd0a0-9975-4e38-b651-e38a3a1655bd tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 200 len: 1317 microversion: 2.1 time: 0.156925 Feb 15 14:26:31.267399 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 183/357] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:31 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:31.578168 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-20d6625e-2d4d-4032-a353-bf1a0b8734d3 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:31.578691 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-20d6625e-2d4d-4032-a353-bf1a0b8734d3 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:31.585211 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-20d6625e-2d4d-4032-a353-bf1a0b8734d3 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:31.585733 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-20d6625e-2d4d-4032-a353-bf1a0b8734d3 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:31.586786 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-20d6625e-2d4d-4032-a353-bf1a0b8734d3 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:31.587439 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-20d6625e-2d4d-4032-a353-bf1a0b8734d3 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:31.753722 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-20d6625e-2d4d-4032-a353-bf1a0b8734d3 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:31.762209 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-20d6625e-2d4d-4032-a353-bf1a0b8734d3 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.187917 Feb 15 14:26:31.762775 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 175/358] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:31 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:32.291889 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-1588d76b-7363-4355-bf6f-c2d983aae4e5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:32.293558 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-1588d76b-7363-4355-bf6f-c2d983aae4e5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:32.302975 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1588d76b-7363-4355-bf6f-c2d983aae4e5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:32.303697 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1588d76b-7363-4355-bf6f-c2d983aae4e5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:32.305008 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1588d76b-7363-4355-bf6f-c2d983aae4e5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:32.305953 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1588d76b-7363-4355-bf6f-c2d983aae4e5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:32.468227 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-1588d76b-7363-4355-bf6f-c2d983aae4e5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:32.476229 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-1588d76b-7363-4355-bf6f-c2d983aae4e5 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 200 len: 1506 microversion: 2.1 time: 0.189455 Feb 15 14:26:32.477029 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 184/359] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:32 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:32.779267 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-3e9a4cae-671e-482a-8d7c-1fa23b3a9495 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:32.779862 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-3e9a4cae-671e-482a-8d7c-1fa23b3a9495 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:32.804100 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3e9a4cae-671e-482a-8d7c-1fa23b3a9495 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:32.804849 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3e9a4cae-671e-482a-8d7c-1fa23b3a9495 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:32.805854 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3e9a4cae-671e-482a-8d7c-1fa23b3a9495 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:32.806911 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3e9a4cae-671e-482a-8d7c-1fa23b3a9495 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:32.968460 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-3e9a4cae-671e-482a-8d7c-1fa23b3a9495 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:32.975938 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-3e9a4cae-671e-482a-8d7c-1fa23b3a9495 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.200706 Feb 15 14:26:32.976625 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 176/360] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:32 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:33.993476 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-e516d551-9408-48cd-a32e-7b6d3625f441 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:33.994074 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-e516d551-9408-48cd-a32e-7b6d3625f441 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:34.000951 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e516d551-9408-48cd-a32e-7b6d3625f441 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:34.001391 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e516d551-9408-48cd-a32e-7b6d3625f441 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:34.002151 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e516d551-9408-48cd-a32e-7b6d3625f441 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:34.002574 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e516d551-9408-48cd-a32e-7b6d3625f441 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:34.134264 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-e516d551-9408-48cd-a32e-7b6d3625f441 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:34.141817 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-e516d551-9408-48cd-a32e-7b6d3625f441 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.151912 Feb 15 14:26:34.142418 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 185/361] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:33 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:35.158735 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-fbe29c85-2f22-4b8e-bd81-550f1e183b04 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:35.159355 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-fbe29c85-2f22-4b8e-bd81-550f1e183b04 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:35.165876 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fbe29c85-2f22-4b8e-bd81-550f1e183b04 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:35.166321 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fbe29c85-2f22-4b8e-bd81-550f1e183b04 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:35.167165 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fbe29c85-2f22-4b8e-bd81-550f1e183b04 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:35.167681 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fbe29c85-2f22-4b8e-bd81-550f1e183b04 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:35.321595 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-fbe29c85-2f22-4b8e-bd81-550f1e183b04 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:35.329452 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-fbe29c85-2f22-4b8e-bd81-550f1e183b04 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.174571 Feb 15 14:26:35.330019 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 177/362] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:35 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:36.346318 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-28ee4e38-a816-42fd-aa3a-c260f3fb4970 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:36.346927 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-28ee4e38-a816-42fd-aa3a-c260f3fb4970 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:36.353203 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-28ee4e38-a816-42fd-aa3a-c260f3fb4970 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:36.353647 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-28ee4e38-a816-42fd-aa3a-c260f3fb4970 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:36.354933 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-28ee4e38-a816-42fd-aa3a-c260f3fb4970 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:36.355373 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-28ee4e38-a816-42fd-aa3a-c260f3fb4970 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:36.499631 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-28ee4e38-a816-42fd-aa3a-c260f3fb4970 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:36.508260 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-28ee4e38-a816-42fd-aa3a-c260f3fb4970 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.165601 Feb 15 14:26:36.508872 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 186/363] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:36 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:37.525402 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-7a97e6a4-7d53-40ca-a29f-4bff0435b53b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:37.526788 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-7a97e6a4-7d53-40ca-a29f-4bff0435b53b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:37.533734 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7a97e6a4-7d53-40ca-a29f-4bff0435b53b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:37.534200 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7a97e6a4-7d53-40ca-a29f-4bff0435b53b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:37.535302 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7a97e6a4-7d53-40ca-a29f-4bff0435b53b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:37.535971 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7a97e6a4-7d53-40ca-a29f-4bff0435b53b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:37.698907 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-7a97e6a4-7d53-40ca-a29f-4bff0435b53b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:37.707345 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-7a97e6a4-7d53-40ca-a29f-4bff0435b53b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.185714 Feb 15 14:26:37.707980 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 178/364] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:37 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:38.107564 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-0d6a857f-885c-42ac-bcc7-26d8753bf983 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "765a73cd-be48-40a2-bce7-b169fb3db633"}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:26:38.109534 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-0d6a857f-885c-42ac-bcc7-26d8753bf983 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:38.115357 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0d6a857f-885c-42ac-bcc7-26d8753bf983 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:38.115801 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0d6a857f-885c-42ac-bcc7-26d8753bf983 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:38.116605 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0d6a857f-885c-42ac-bcc7-26d8753bf983 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:38.117033 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0d6a857f-885c-42ac-bcc7-26d8753bf983 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:38.397176 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-0d6a857f-885c-42ac-bcc7-26d8753bf983 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "POST /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294930 Feb 15 14:26:38.402790 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 187/365] 10.222.0.83 () {60 vars in 1322 bytes} [Tue Feb 15 14:26:38 2022] POST /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:26:38.724827 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-e007e899-f9b5-4e35-bc33-67ace1a4811f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:38.726025 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-e007e899-f9b5-4e35-bc33-67ace1a4811f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:38.733164 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e007e899-f9b5-4e35-bc33-67ace1a4811f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:38.733615 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e007e899-f9b5-4e35-bc33-67ace1a4811f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:38.734411 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e007e899-f9b5-4e35-bc33-67ace1a4811f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:38.734847 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e007e899-f9b5-4e35-bc33-67ace1a4811f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:38.893035 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-e007e899-f9b5-4e35-bc33-67ace1a4811f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:38.903266 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-e007e899-f9b5-4e35-bc33-67ace1a4811f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.182006 Feb 15 14:26:38.904336 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 179/366] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:38 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:39.923236 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-0c885c10-dbbb-439f-827b-336bd18228a1 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:39.924080 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-0c885c10-dbbb-439f-827b-336bd18228a1 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:39.931746 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0c885c10-dbbb-439f-827b-336bd18228a1 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:39.932219 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0c885c10-dbbb-439f-827b-336bd18228a1 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:39.933348 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0c885c10-dbbb-439f-827b-336bd18228a1 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:39.933729 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0c885c10-dbbb-439f-827b-336bd18228a1 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:40.082050 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-0c885c10-dbbb-439f-827b-336bd18228a1 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:40.093205 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-0c885c10-dbbb-439f-827b-336bd18228a1 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.175090 Feb 15 14:26:40.094151 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 188/367] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:39 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:41.111149 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-f1c01ea0-2929-416c-bf6a-abd58b2d783a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:41.111807 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-f1c01ea0-2929-416c-bf6a-abd58b2d783a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:41.118352 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f1c01ea0-2929-416c-bf6a-abd58b2d783a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:41.118806 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f1c01ea0-2929-416c-bf6a-abd58b2d783a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:41.119582 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f1c01ea0-2929-416c-bf6a-abd58b2d783a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:41.120301 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f1c01ea0-2929-416c-bf6a-abd58b2d783a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:41.259721 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-f1c01ea0-2929-416c-bf6a-abd58b2d783a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:41.267697 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-f1c01ea0-2929-416c-bf6a-abd58b2d783a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.160219 Feb 15 14:26:41.268259 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 180/368] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:41 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:42.284203 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-a1dc74c4-06b4-430d-8e7a-25401f0a24da tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:42.285120 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-a1dc74c4-06b4-430d-8e7a-25401f0a24da tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:42.292181 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a1dc74c4-06b4-430d-8e7a-25401f0a24da tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:42.292663 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a1dc74c4-06b4-430d-8e7a-25401f0a24da tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:42.293593 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a1dc74c4-06b4-430d-8e7a-25401f0a24da tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:42.294028 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a1dc74c4-06b4-430d-8e7a-25401f0a24da tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:42.430286 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a1dc74c4-06b4-430d-8e7a-25401f0a24da tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:42.439346 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-a1dc74c4-06b4-430d-8e7a-25401f0a24da tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.158706 Feb 15 14:26:42.439904 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 189/369] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:42 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:43.456996 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-2a67300b-4934-452e-946e-ec6b3feb19ce tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:43.457636 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-2a67300b-4934-452e-946e-ec6b3feb19ce tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:43.464571 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2a67300b-4934-452e-946e-ec6b3feb19ce tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:43.465201 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2a67300b-4934-452e-946e-ec6b3feb19ce tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:43.466051 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2a67300b-4934-452e-946e-ec6b3feb19ce tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:43.466862 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2a67300b-4934-452e-946e-ec6b3feb19ce tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:43.716146 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-2a67300b-4934-452e-946e-ec6b3feb19ce tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:43.727165 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-2a67300b-4934-452e-946e-ec6b3feb19ce tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.274367 Feb 15 14:26:43.729957 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 181/370] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:43 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:44.748161 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-8455008d-fc5b-4ed9-96d4-1f02c4c68e2e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:44.750848 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-8455008d-fc5b-4ed9-96d4-1f02c4c68e2e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:44.782587 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8455008d-fc5b-4ed9-96d4-1f02c4c68e2e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:44.786731 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8455008d-fc5b-4ed9-96d4-1f02c4c68e2e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:44.791748 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8455008d-fc5b-4ed9-96d4-1f02c4c68e2e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:44.792587 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8455008d-fc5b-4ed9-96d4-1f02c4c68e2e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:45.062068 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-8455008d-fc5b-4ed9-96d4-1f02c4c68e2e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:45.071858 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-8455008d-fc5b-4ed9-96d4-1f02c4c68e2e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.328904 Feb 15 14:26:45.073514 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 190/371] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:44 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:46.089783 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-eb584495-8bea-4279-b067-00d75632aac0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:46.090430 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-eb584495-8bea-4279-b067-00d75632aac0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:46.098996 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-eb584495-8bea-4279-b067-00d75632aac0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:46.099478 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-eb584495-8bea-4279-b067-00d75632aac0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:46.100293 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-eb584495-8bea-4279-b067-00d75632aac0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:46.100829 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-eb584495-8bea-4279-b067-00d75632aac0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:46.193125 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-05fbfe1a-a20a-4c45-bbd1-257a93458690 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:46.201774 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-05fbfe1a-a20a-4c45-bbd1-257a93458690 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:46.216373 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-05fbfe1a-a20a-4c45-bbd1-257a93458690 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:46.217632 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-05fbfe1a-a20a-4c45-bbd1-257a93458690 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:46.220801 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-05fbfe1a-a20a-4c45-bbd1-257a93458690 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:46.221419 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-05fbfe1a-a20a-4c45-bbd1-257a93458690 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:46.281378 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-eb584495-8bea-4279-b067-00d75632aac0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:46.295709 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-eb584495-8bea-4279-b067-00d75632aac0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.205296 Feb 15 14:26:46.296332 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 182/372] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:46 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:46.327518 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.objects.instance [None req-05fbfe1a-a20a-4c45-bbd1-257a93458690 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lazy-loading 'services' on Instance uuid 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c {{(pid=116363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:26:46.418001 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-05fbfe1a-a20a-4c45-bbd1-257a93458690 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "DELETE /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c/os-volume_attachments/765a73cd-be48-40a2-bce7-b169fb3db633" status: 202 len: 0 microversion: 2.1 time: 0.228778 Feb 15 14:26:46.419068 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 191/373] 10.222.0.83 () {58 vars in 1415 bytes} [Tue Feb 15 14:26:46 2022] DELETE /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c/os-volume_attachments/765a73cd-be48-40a2-bce7-b169fb3db633 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:26:46.440975 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-c3a34cc2-77a1-4fc0-b47b-de7a99e466fa tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:46.442523 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-c3a34cc2-77a1-4fc0-b47b-de7a99e466fa tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:46.454146 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c3a34cc2-77a1-4fc0-b47b-de7a99e466fa tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:46.454888 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c3a34cc2-77a1-4fc0-b47b-de7a99e466fa tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:46.456181 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c3a34cc2-77a1-4fc0-b47b-de7a99e466fa tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:46.456866 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c3a34cc2-77a1-4fc0-b47b-de7a99e466fa tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:46.503752 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-c3a34cc2-77a1-4fc0-b47b-de7a99e466fa tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079937 Feb 15 14:26:46.504775 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 183/374] 10.222.0.83 () {58 vars in 1301 bytes} [Tue Feb 15 14:26:46 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:26:47.316023 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-494ba4b4-1bd2-4899-b510-589a549b713d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:47.317845 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-494ba4b4-1bd2-4899-b510-589a549b713d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:47.327805 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-494ba4b4-1bd2-4899-b510-589a549b713d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:47.328939 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-494ba4b4-1bd2-4899-b510-589a549b713d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:47.330309 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-494ba4b4-1bd2-4899-b510-589a549b713d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:47.331003 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-494ba4b4-1bd2-4899-b510-589a549b713d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:47.518201 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-8236e877-2618-4fbe-9b6c-816da3dcdcfc tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:47.519792 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-8236e877-2618-4fbe-9b6c-816da3dcdcfc tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:47.529195 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8236e877-2618-4fbe-9b6c-816da3dcdcfc tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:47.529881 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8236e877-2618-4fbe-9b6c-816da3dcdcfc tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:47.534134 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-494ba4b4-1bd2-4899-b510-589a549b713d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:47.539137 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8236e877-2618-4fbe-9b6c-816da3dcdcfc tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:47.545100 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8236e877-2618-4fbe-9b6c-816da3dcdcfc tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:47.548431 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-494ba4b4-1bd2-4899-b510-589a549b713d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.237856 Feb 15 14:26:47.549219 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 192/375] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:47 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:47.592763 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-8236e877-2618-4fbe-9b6c-816da3dcdcfc tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081134 Feb 15 14:26:47.593342 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 184/376] 10.222.0.83 () {58 vars in 1301 bytes} [Tue Feb 15 14:26:47 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:26:48.574392 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-a62e4bde-9887-48d2-8e9d-f46d94de3740 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:48.575174 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-a62e4bde-9887-48d2-8e9d-f46d94de3740 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:48.581745 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a62e4bde-9887-48d2-8e9d-f46d94de3740 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:48.582341 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a62e4bde-9887-48d2-8e9d-f46d94de3740 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:48.583259 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a62e4bde-9887-48d2-8e9d-f46d94de3740 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:48.583694 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a62e4bde-9887-48d2-8e9d-f46d94de3740 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:48.605330 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-9addcfa7-e16a-466d-afc1-e73574ca595d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:48.607262 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-9addcfa7-e16a-466d-afc1-e73574ca595d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:48.614429 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9addcfa7-e16a-466d-afc1-e73574ca595d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:48.614875 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9addcfa7-e16a-466d-afc1-e73574ca595d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:48.615912 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9addcfa7-e16a-466d-afc1-e73574ca595d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:48.616469 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9addcfa7-e16a-466d-afc1-e73574ca595d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:48.660084 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-9addcfa7-e16a-466d-afc1-e73574ca595d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059277 Feb 15 14:26:48.660893 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 185/377] 10.222.0.83 () {58 vars in 1301 bytes} [Tue Feb 15 14:26:48 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:26:48.745979 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a62e4bde-9887-48d2-8e9d-f46d94de3740 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:48.753214 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-a62e4bde-9887-48d2-8e9d-f46d94de3740 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.184059 Feb 15 14:26:48.753783 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 193/378] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:48 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:49.671250 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-22221376-5c77-4118-9e02-d7e25ac3ae0a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:49.672109 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-22221376-5c77-4118-9e02-d7e25ac3ae0a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:49.678384 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-22221376-5c77-4118-9e02-d7e25ac3ae0a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:49.678825 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-22221376-5c77-4118-9e02-d7e25ac3ae0a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:49.679585 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-22221376-5c77-4118-9e02-d7e25ac3ae0a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:49.680009 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-22221376-5c77-4118-9e02-d7e25ac3ae0a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:49.708710 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-22221376-5c77-4118-9e02-d7e25ac3ae0a tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041216 Feb 15 14:26:49.709413 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 186/379] 10.222.0.83 () {58 vars in 1301 bytes} [Tue Feb 15 14:26:49 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:26:49.770293 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-57074372-569d-40fb-93d1-8a2b2680b9c9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:49.770923 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-57074372-569d-40fb-93d1-8a2b2680b9c9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:49.777955 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-57074372-569d-40fb-93d1-8a2b2680b9c9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:49.778395 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-57074372-569d-40fb-93d1-8a2b2680b9c9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:49.779156 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-57074372-569d-40fb-93d1-8a2b2680b9c9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:49.779582 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-57074372-569d-40fb-93d1-8a2b2680b9c9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:49.911072 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-57074372-569d-40fb-93d1-8a2b2680b9c9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:49.918513 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-57074372-569d-40fb-93d1-8a2b2680b9c9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.151759 Feb 15 14:26:49.919082 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 194/380] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:49 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:50.721226 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-db83c03d-3c81-4e22-ac62-6afeb32a9129 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:50.722056 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-db83c03d-3c81-4e22-ac62-6afeb32a9129 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:50.728358 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-db83c03d-3c81-4e22-ac62-6afeb32a9129 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:50.729481 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-db83c03d-3c81-4e22-ac62-6afeb32a9129 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:50.730287 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-db83c03d-3c81-4e22-ac62-6afeb32a9129 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:50.730723 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-db83c03d-3c81-4e22-ac62-6afeb32a9129 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:50.759610 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-db83c03d-3c81-4e22-ac62-6afeb32a9129 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042536 Feb 15 14:26:50.760604 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 187/381] 10.222.0.83 () {58 vars in 1301 bytes} [Tue Feb 15 14:26:50 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:26:50.935564 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-0a935154-77cb-47bc-a211-c5e0320d0825 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:50.936333 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-0a935154-77cb-47bc-a211-c5e0320d0825 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:50.946393 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0a935154-77cb-47bc-a211-c5e0320d0825 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:50.946907 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0a935154-77cb-47bc-a211-c5e0320d0825 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:50.948181 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0a935154-77cb-47bc-a211-c5e0320d0825 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:50.948651 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0a935154-77cb-47bc-a211-c5e0320d0825 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:51.098261 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-0a935154-77cb-47bc-a211-c5e0320d0825 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:51.108213 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-0a935154-77cb-47bc-a211-c5e0320d0825 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.176549 Feb 15 14:26:51.108859 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 195/382] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:50 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:51.771966 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-15056e42-0e6b-4358-9c19-1fa4fc95fdbd tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:51.774220 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-15056e42-0e6b-4358-9c19-1fa4fc95fdbd tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:51.782433 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-15056e42-0e6b-4358-9c19-1fa4fc95fdbd tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:51.783200 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-15056e42-0e6b-4358-9c19-1fa4fc95fdbd tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:51.784204 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-15056e42-0e6b-4358-9c19-1fa4fc95fdbd tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:51.785429 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-15056e42-0e6b-4358-9c19-1fa4fc95fdbd tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:51.825767 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-15056e42-0e6b-4358-9c19-1fa4fc95fdbd tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057896 Feb 15 14:26:51.827173 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 188/383] 10.222.0.83 () {58 vars in 1301 bytes} [Tue Feb 15 14:26:51 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 15 14:26:52.133035 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-3e9d5d40-b3b6-4517-a300-b4b8bc2ed4f7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:52.133614 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-3e9d5d40-b3b6-4517-a300-b4b8bc2ed4f7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:52.142004 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3e9d5d40-b3b6-4517-a300-b4b8bc2ed4f7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:52.142982 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3e9d5d40-b3b6-4517-a300-b4b8bc2ed4f7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:52.143959 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3e9d5d40-b3b6-4517-a300-b4b8bc2ed4f7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:52.144576 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3e9d5d40-b3b6-4517-a300-b4b8bc2ed4f7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:52.286939 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-3e9d5d40-b3b6-4517-a300-b4b8bc2ed4f7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:52.295569 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-3e9d5d40-b3b6-4517-a300-b4b8bc2ed4f7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.173620 Feb 15 14:26:52.296695 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 196/384] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:52 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:53.313083 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-be3cfb1a-0647-4b35-8ef3-d44ac3898c49 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:53.313842 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-be3cfb1a-0647-4b35-8ef3-d44ac3898c49 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:53.320879 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-be3cfb1a-0647-4b35-8ef3-d44ac3898c49 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:53.321607 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-be3cfb1a-0647-4b35-8ef3-d44ac3898c49 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:53.322584 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-be3cfb1a-0647-4b35-8ef3-d44ac3898c49 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:53.323287 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-be3cfb1a-0647-4b35-8ef3-d44ac3898c49 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:53.475785 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-be3cfb1a-0647-4b35-8ef3-d44ac3898c49 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:53.483182 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-be3cfb1a-0647-4b35-8ef3-d44ac3898c49 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.173949 Feb 15 14:26:53.483753 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 189/385] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:53 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:54.499948 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-dd8f791e-3ef1-4748-94cd-afb99fcbb1d2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:54.500633 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-dd8f791e-3ef1-4748-94cd-afb99fcbb1d2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:54.507351 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dd8f791e-3ef1-4748-94cd-afb99fcbb1d2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:54.507800 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dd8f791e-3ef1-4748-94cd-afb99fcbb1d2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:54.508617 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dd8f791e-3ef1-4748-94cd-afb99fcbb1d2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:54.509292 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dd8f791e-3ef1-4748-94cd-afb99fcbb1d2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:54.657147 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-dd8f791e-3ef1-4748-94cd-afb99fcbb1d2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:54.665961 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-dd8f791e-3ef1-4748-94cd-afb99fcbb1d2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.169727 Feb 15 14:26:54.667485 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 197/386] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:54 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:55.684870 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-3a76f122-f70c-4869-ae2b-e4f0e0b112fd tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:55.685543 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-3a76f122-f70c-4869-ae2b-e4f0e0b112fd tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:55.692535 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3a76f122-f70c-4869-ae2b-e4f0e0b112fd tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:55.692979 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3a76f122-f70c-4869-ae2b-e4f0e0b112fd tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:55.693782 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3a76f122-f70c-4869-ae2b-e4f0e0b112fd tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:55.694208 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3a76f122-f70c-4869-ae2b-e4f0e0b112fd tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:55.833498 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-3a76f122-f70c-4869-ae2b-e4f0e0b112fd tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:55.840690 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-3a76f122-f70c-4869-ae2b-e4f0e0b112fd tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.160459 Feb 15 14:26:55.841254 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 190/387] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:55 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:56.859310 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-42743992-944a-4df2-9ebf-3e6c17427c0c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:56.860119 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-42743992-944a-4df2-9ebf-3e6c17427c0c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:56.866581 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-42743992-944a-4df2-9ebf-3e6c17427c0c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:56.867095 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-42743992-944a-4df2-9ebf-3e6c17427c0c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:56.868098 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-42743992-944a-4df2-9ebf-3e6c17427c0c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:56.868671 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-42743992-944a-4df2-9ebf-3e6c17427c0c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:57.014380 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-42743992-944a-4df2-9ebf-3e6c17427c0c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:57.022871 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-42743992-944a-4df2-9ebf-3e6c17427c0c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.167261 Feb 15 14:26:57.023645 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 198/388] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:56 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:57.496232 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-07d3ae65-1420-432d-827d-e8fb3c7b4347 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:26:57.496816 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-07d3ae65-1420-432d-827d-e8fb3c7b4347 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:57.502998 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-07d3ae65-1420-432d-827d-e8fb3c7b4347 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:57.503438 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-07d3ae65-1420-432d-827d-e8fb3c7b4347 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:57.504614 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-07d3ae65-1420-432d-827d-e8fb3c7b4347 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:57.505024 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-07d3ae65-1420-432d-827d-e8fb3c7b4347 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:57.527647 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.objects.instance [None req-07d3ae65-1420-432d-827d-e8fb3c7b4347 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lazy-loading 'flavor' on Instance uuid 9c04d927-9f34-4f11-8502-7175a64e3923 {{(pid=116362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:26:57.778869 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-07d3ae65-1420-432d-827d-e8fb3c7b4347 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "POST /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923/action" status: 202 len: 0 microversion: 2.20 time: 0.286352 Feb 15 14:26:57.779480 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 191/389] 10.222.0.83 () {62 vars in 1318 bytes} [Tue Feb 15 14:26:57 2022] POST /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 15 14:26:57.787863 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-3ce45787-a660-4b24-826d-763255800aa6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:57.788509 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-3ce45787-a660-4b24-826d-763255800aa6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:57.796019 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3ce45787-a660-4b24-826d-763255800aa6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:57.796515 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3ce45787-a660-4b24-826d-763255800aa6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:57.797307 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3ce45787-a660-4b24-826d-763255800aa6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:57.797747 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3ce45787-a660-4b24-826d-763255800aa6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:57.936504 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-3ce45787-a660-4b24-826d-763255800aa6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:57.944191 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-3ce45787-a660-4b24-826d-763255800aa6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:57.945731 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-3ce45787-a660-4b24-826d-763255800aa6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:57.946880 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-3ce45787-a660-4b24-826d-763255800aa6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1722 microversion: 2.20 time: 0.163058 Feb 15 14:26:57.948077 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 199/390] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:26:57 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:26:58.041167 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-48213d05-bb04-4206-a5f2-1f923cf06103 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:58.041776 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-48213d05-bb04-4206-a5f2-1f923cf06103 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:58.047864 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-48213d05-bb04-4206-a5f2-1f923cf06103 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:58.048314 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-48213d05-bb04-4206-a5f2-1f923cf06103 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:58.049116 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-48213d05-bb04-4206-a5f2-1f923cf06103 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:58.049546 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-48213d05-bb04-4206-a5f2-1f923cf06103 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:58.181964 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-48213d05-bb04-4206-a5f2-1f923cf06103 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:58.189184 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-48213d05-bb04-4206-a5f2-1f923cf06103 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.152085 Feb 15 14:26:58.189751 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 192/391] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:58 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:26:58.966405 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-a7332fbd-747e-4f5b-bdcc-5a4df416f525 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:58.967016 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-a7332fbd-747e-4f5b-bdcc-5a4df416f525 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:58.973424 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a7332fbd-747e-4f5b-bdcc-5a4df416f525 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:58.973874 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a7332fbd-747e-4f5b-bdcc-5a4df416f525 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:58.974649 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a7332fbd-747e-4f5b-bdcc-5a4df416f525 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:58.975082 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a7332fbd-747e-4f5b-bdcc-5a4df416f525 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:59.104587 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a7332fbd-747e-4f5b-bdcc-5a4df416f525 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:59.113316 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a7332fbd-747e-4f5b-bdcc-5a4df416f525 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:59.114814 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a7332fbd-747e-4f5b-bdcc-5a4df416f525 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:59.115961 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-a7332fbd-747e-4f5b-bdcc-5a4df416f525 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1722 microversion: 2.20 time: 0.153901 Feb 15 14:26:59.116566 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 200/392] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:26:58 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:26:59.206287 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-07b9d5fe-5524-48b4-b851-db13acb30bc7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:26:59.206893 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-07b9d5fe-5524-48b4-b851-db13acb30bc7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:26:59.213949 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-07b9d5fe-5524-48b4-b851-db13acb30bc7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:59.214386 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-07b9d5fe-5524-48b4-b851-db13acb30bc7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:59.215154 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-07b9d5fe-5524-48b4-b851-db13acb30bc7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:26:59.215657 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-07b9d5fe-5524-48b4-b851-db13acb30bc7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:26:59.352301 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-07b9d5fe-5524-48b4-b851-db13acb30bc7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:26:59.360193 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-07b9d5fe-5524-48b4-b851-db13acb30bc7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.157499 Feb 15 14:26:59.360797 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 193/393] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:26:59 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:00.135398 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-e29a628f-1519-4e49-a74b-2038c4e494d9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:00.135947 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-e29a628f-1519-4e49-a74b-2038c4e494d9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:00.142274 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e29a628f-1519-4e49-a74b-2038c4e494d9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:00.142722 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e29a628f-1519-4e49-a74b-2038c4e494d9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:00.143491 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e29a628f-1519-4e49-a74b-2038c4e494d9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:00.143931 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e29a628f-1519-4e49-a74b-2038c4e494d9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:00.278058 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-e29a628f-1519-4e49-a74b-2038c4e494d9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:00.285922 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-e29a628f-1519-4e49-a74b-2038c4e494d9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:00.287416 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-e29a628f-1519-4e49-a74b-2038c4e494d9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:00.288585 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-e29a628f-1519-4e49-a74b-2038c4e494d9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1722 microversion: 2.20 time: 0.157636 Feb 15 14:27:00.289143 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 201/394] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:00 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:00.376606 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-9e8cc2b7-b15c-4067-99e5-9ef4d23014cf tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:00.377208 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-9e8cc2b7-b15c-4067-99e5-9ef4d23014cf tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:00.383361 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9e8cc2b7-b15c-4067-99e5-9ef4d23014cf tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:00.383805 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9e8cc2b7-b15c-4067-99e5-9ef4d23014cf tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:00.385225 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9e8cc2b7-b15c-4067-99e5-9ef4d23014cf tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:00.385711 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9e8cc2b7-b15c-4067-99e5-9ef4d23014cf tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:00.518244 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-9e8cc2b7-b15c-4067-99e5-9ef4d23014cf tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:00.532147 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-9e8cc2b7-b15c-4067-99e5-9ef4d23014cf tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.158717 Feb 15 14:27:00.533253 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 194/395] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:00 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:01.307662 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-ec68fe32-52d7-4d3b-bf27-97958f82c45d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:01.308260 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-ec68fe32-52d7-4d3b-bf27-97958f82c45d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:01.314714 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ec68fe32-52d7-4d3b-bf27-97958f82c45d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:01.315156 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ec68fe32-52d7-4d3b-bf27-97958f82c45d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:01.315931 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ec68fe32-52d7-4d3b-bf27-97958f82c45d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:01.316389 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ec68fe32-52d7-4d3b-bf27-97958f82c45d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:01.451573 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-ec68fe32-52d7-4d3b-bf27-97958f82c45d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:01.460122 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-ec68fe32-52d7-4d3b-bf27-97958f82c45d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:01.461686 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-ec68fe32-52d7-4d3b-bf27-97958f82c45d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:01.462916 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-ec68fe32-52d7-4d3b-bf27-97958f82c45d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1722 microversion: 2.20 time: 0.159613 Feb 15 14:27:01.463573 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 202/396] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:01 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:01.550457 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-f2422682-e827-4a88-9e05-97459d79f268 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:01.551058 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-f2422682-e827-4a88-9e05-97459d79f268 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:01.558899 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f2422682-e827-4a88-9e05-97459d79f268 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:01.559383 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f2422682-e827-4a88-9e05-97459d79f268 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:01.560681 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f2422682-e827-4a88-9e05-97459d79f268 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:01.561114 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f2422682-e827-4a88-9e05-97459d79f268 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:01.704207 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-f2422682-e827-4a88-9e05-97459d79f268 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:01.711581 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-f2422682-e827-4a88-9e05-97459d79f268 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1501 microversion: 2.1 time: 0.164991 Feb 15 14:27:01.712139 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 195/397] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:01 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:01.727766 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-bc19d9f7-7e6b-406f-bc96-27323d79e469 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76c42ee7-811b-4422-8076-b541474ee7ac"}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:27:01.729716 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-bc19d9f7-7e6b-406f-bc96-27323d79e469 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:01.735687 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bc19d9f7-7e6b-406f-bc96-27323d79e469 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:01.736129 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bc19d9f7-7e6b-406f-bc96-27323d79e469 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:01.736930 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bc19d9f7-7e6b-406f-bc96-27323d79e469 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:01.737358 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bc19d9f7-7e6b-406f-bc96-27323d79e469 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:01.762684 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.wsgi [None req-bc19d9f7-7e6b-406f-bc96-27323d79e469 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] HTTP exception thrown: Cannot 'attach_volume' instance 13edf4fd-20da-43ce-bb58-5757dc0f96c7 while it is in vm_state rescued Feb 15 14:27:01.763271 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-bc19d9f7-7e6b-406f-bc96-27323d79e469 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Returning 409 to user: Cannot 'attach_volume' instance 13edf4fd-20da-43ce-bb58-5757dc0f96c7 while it is in vm_state rescued {{(pid=116363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:27:01.764144 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-bc19d9f7-7e6b-406f-bc96-27323d79e469 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "POST /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040169 Feb 15 14:27:01.765152 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 203/398] 10.222.0.83 () {60 vars in 1322 bytes} [Tue Feb 15 14:27:01 2022] POST /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 15 14:27:01.773705 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-dc4e0bb7-51c2-4611-9d85-07b748bf8a86 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:27:01.774293 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-dc4e0bb7-51c2-4611-9d85-07b748bf8a86 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:01.781292 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-dc4e0bb7-51c2-4611-9d85-07b748bf8a86 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:01.781737 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-dc4e0bb7-51c2-4611-9d85-07b748bf8a86 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:01.782564 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-dc4e0bb7-51c2-4611-9d85-07b748bf8a86 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:01.783075 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-dc4e0bb7-51c2-4611-9d85-07b748bf8a86 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:01.852846 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-dc4e0bb7-51c2-4611-9d85-07b748bf8a86 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "POST /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/action" status: 202 len: 0 microversion: 2.1 time: 0.082899 Feb 15 14:27:01.853498 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 196/399] 10.222.0.83 () {60 vars in 1277 bytes} [Tue Feb 15 14:27:01 2022] POST /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 15 14:27:01.862324 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-fb881d5a-4cad-4e72-b484-9a36c3c78445 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:01.863130 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-fb881d5a-4cad-4e72-b484-9a36c3c78445 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:01.872626 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-fb881d5a-4cad-4e72-b484-9a36c3c78445 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:01.873095 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-fb881d5a-4cad-4e72-b484-9a36c3c78445 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:01.876094 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-fb881d5a-4cad-4e72-b484-9a36c3c78445 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:01.877161 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-fb881d5a-4cad-4e72-b484-9a36c3c78445 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:02.120565 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-fb881d5a-4cad-4e72-b484-9a36c3c78445 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:02.129796 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-fb881d5a-4cad-4e72-b484-9a36c3c78445 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1509 microversion: 2.1 time: 0.271790 Feb 15 14:27:02.130595 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 204/400] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:01 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1509 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:02.485477 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-bcba4782-da4d-4f9d-80b1-4bd194efd46e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:02.486776 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-bcba4782-da4d-4f9d-80b1-4bd194efd46e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:02.495521 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bcba4782-da4d-4f9d-80b1-4bd194efd46e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:02.495982 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bcba4782-da4d-4f9d-80b1-4bd194efd46e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:02.496793 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bcba4782-da4d-4f9d-80b1-4bd194efd46e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:02.497231 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bcba4782-da4d-4f9d-80b1-4bd194efd46e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:02.627084 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-946512b7-7194-40fc-8d17-51eae9c5c436 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:02.627573 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-946512b7-7194-40fc-8d17-51eae9c5c436 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:02.639024 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-946512b7-7194-40fc-8d17-51eae9c5c436 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:02.639492 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-946512b7-7194-40fc-8d17-51eae9c5c436 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:02.640565 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-946512b7-7194-40fc-8d17-51eae9c5c436 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:02.641016 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-946512b7-7194-40fc-8d17-51eae9c5c436 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:02.683017 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-bcba4782-da4d-4f9d-80b1-4bd194efd46e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:02.686594 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-946512b7-7194-40fc-8d17-51eae9c5c436 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Going to try to terminate instance {{(pid=116363) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 14:27:02.692199 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-bcba4782-da4d-4f9d-80b1-4bd194efd46e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:02.693841 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-bcba4782-da4d-4f9d-80b1-4bd194efd46e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:02.695198 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-bcba4782-da4d-4f9d-80b1-4bd194efd46e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1722 microversion: 2.20 time: 0.218265 Feb 15 14:27:02.695819 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 197/401] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:02 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:02.764654 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-946512b7-7194-40fc-8d17-51eae9c5c436 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "DELETE /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 204 len: 0 microversion: 2.1 time: 0.141796 Feb 15 14:27:02.765233 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 205/402] 10.222.0.83 () {58 vars in 1238 bytes} [Tue Feb 15 14:27:02 2022] DELETE /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 14:27:02.773020 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-3832d3ad-ccf0-4b41-9e36-a1a13b83b50b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:02.773629 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-3832d3ad-ccf0-4b41-9e36-a1a13b83b50b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:02.779677 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3832d3ad-ccf0-4b41-9e36-a1a13b83b50b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:02.780123 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3832d3ad-ccf0-4b41-9e36-a1a13b83b50b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:02.780920 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3832d3ad-ccf0-4b41-9e36-a1a13b83b50b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:02.781346 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3832d3ad-ccf0-4b41-9e36-a1a13b83b50b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:02.914768 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-3832d3ad-ccf0-4b41-9e36-a1a13b83b50b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:02.922270 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-3832d3ad-ccf0-4b41-9e36-a1a13b83b50b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 200 len: 1512 microversion: 2.1 time: 0.152872 Feb 15 14:27:02.923007 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 198/403] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:02 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:27:03.147399 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-3d295515-e179-4f39-a497-46c08e888ccb tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:03.148153 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-3d295515-e179-4f39-a497-46c08e888ccb tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:03.154561 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3d295515-e179-4f39-a497-46c08e888ccb tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:03.155094 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3d295515-e179-4f39-a497-46c08e888ccb tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:03.155883 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3d295515-e179-4f39-a497-46c08e888ccb tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:03.156319 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3d295515-e179-4f39-a497-46c08e888ccb tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:03.293441 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-3d295515-e179-4f39-a497-46c08e888ccb tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:03.300632 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-3d295515-e179-4f39-a497-46c08e888ccb tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1509 microversion: 2.1 time: 0.157274 Feb 15 14:27:03.301205 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 206/404] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:03 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:03.714556 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-270bfb88-f52b-4fe2-87c3-07e30e78308c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:03.715161 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-270bfb88-f52b-4fe2-87c3-07e30e78308c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:03.721368 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-270bfb88-f52b-4fe2-87c3-07e30e78308c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:03.721822 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-270bfb88-f52b-4fe2-87c3-07e30e78308c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:03.722597 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-270bfb88-f52b-4fe2-87c3-07e30e78308c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:03.723034 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-270bfb88-f52b-4fe2-87c3-07e30e78308c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:03.883275 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-270bfb88-f52b-4fe2-87c3-07e30e78308c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:03.891672 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-270bfb88-f52b-4fe2-87c3-07e30e78308c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:03.893210 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-270bfb88-f52b-4fe2-87c3-07e30e78308c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:03.894650 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-270bfb88-f52b-4fe2-87c3-07e30e78308c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1722 microversion: 2.20 time: 0.184431 Feb 15 14:27:03.895398 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 199/405] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:03 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:03.938943 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-007dbc66-68ae-4a02-b646-813d0c8a3d44 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:03.939688 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-007dbc66-68ae-4a02-b646-813d0c8a3d44 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:03.945967 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-007dbc66-68ae-4a02-b646-813d0c8a3d44 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:03.946413 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-007dbc66-68ae-4a02-b646-813d0c8a3d44 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:03.947953 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-007dbc66-68ae-4a02-b646-813d0c8a3d44 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:03.948594 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-007dbc66-68ae-4a02-b646-813d0c8a3d44 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:04.167339 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-007dbc66-68ae-4a02-b646-813d0c8a3d44 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:04.175363 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-007dbc66-68ae-4a02-b646-813d0c8a3d44 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 200 len: 1512 microversion: 2.1 time: 0.240057 Feb 15 14:27:04.176136 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 207/406] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:03 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 1512 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:04.318078 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-f14a86f3-680a-4568-8024-386a954671bf tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:04.318735 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-f14a86f3-680a-4568-8024-386a954671bf tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:04.325760 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f14a86f3-680a-4568-8024-386a954671bf tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:04.326208 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f14a86f3-680a-4568-8024-386a954671bf tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:04.327203 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f14a86f3-680a-4568-8024-386a954671bf tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:04.327642 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f14a86f3-680a-4568-8024-386a954671bf tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:04.488331 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-f14a86f3-680a-4568-8024-386a954671bf tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:04.497041 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-f14a86f3-680a-4568-8024-386a954671bf tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1509 microversion: 2.1 time: 0.182590 Feb 15 14:27:04.497929 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 200/407] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:04 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1509 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:04.913789 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-601e0101-7d03-4d4f-babc-185f31614ca2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:04.914389 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-601e0101-7d03-4d4f-babc-185f31614ca2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:04.920658 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-601e0101-7d03-4d4f-babc-185f31614ca2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:04.921101 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-601e0101-7d03-4d4f-babc-185f31614ca2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:04.921858 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-601e0101-7d03-4d4f-babc-185f31614ca2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:04.922294 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-601e0101-7d03-4d4f-babc-185f31614ca2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:05.059358 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-601e0101-7d03-4d4f-babc-185f31614ca2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:05.066989 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-601e0101-7d03-4d4f-babc-185f31614ca2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:05.068486 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-601e0101-7d03-4d4f-babc-185f31614ca2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:05.069612 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-601e0101-7d03-4d4f-babc-185f31614ca2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1722 microversion: 2.20 time: 0.159511 Feb 15 14:27:05.070167 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 208/408] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:04 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:05.193649 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-871bc29f-a525-4857-bdb0-b91a3f9a204f tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:05.194180 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-871bc29f-a525-4857-bdb0-b91a3f9a204f tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:05.201247 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-871bc29f-a525-4857-bdb0-b91a3f9a204f tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:05.201695 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-871bc29f-a525-4857-bdb0-b91a3f9a204f tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:05.202540 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-871bc29f-a525-4857-bdb0-b91a3f9a204f tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:05.202975 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-871bc29f-a525-4857-bdb0-b91a3f9a204f tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:05.333999 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-871bc29f-a525-4857-bdb0-b91a3f9a204f tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:05.341711 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-871bc29f-a525-4857-bdb0-b91a3f9a204f tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 200 len: 1512 microversion: 2.1 time: 0.152097 Feb 15 14:27:05.342284 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 201/409] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:05 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:05.514672 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-08990853-1987-43e7-acd7-408857afb70c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:05.515187 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-08990853-1987-43e7-acd7-408857afb70c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:05.521273 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-08990853-1987-43e7-acd7-408857afb70c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:05.521727 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-08990853-1987-43e7-acd7-408857afb70c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:05.522488 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-08990853-1987-43e7-acd7-408857afb70c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:05.522921 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-08990853-1987-43e7-acd7-408857afb70c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:05.656520 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-08990853-1987-43e7-acd7-408857afb70c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:05.664002 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-08990853-1987-43e7-acd7-408857afb70c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1509 microversion: 2.1 time: 0.153012 Feb 15 14:27:05.664593 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 209/410] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:05 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:06.087937 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-446d6c33-b336-4daa-9d47-353c2863f8f5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:06.088628 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-446d6c33-b336-4daa-9d47-353c2863f8f5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:06.094630 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-446d6c33-b336-4daa-9d47-353c2863f8f5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:06.095080 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-446d6c33-b336-4daa-9d47-353c2863f8f5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:06.095854 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-446d6c33-b336-4daa-9d47-353c2863f8f5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:06.096293 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-446d6c33-b336-4daa-9d47-353c2863f8f5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:06.225977 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-446d6c33-b336-4daa-9d47-353c2863f8f5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:06.234218 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-446d6c33-b336-4daa-9d47-353c2863f8f5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:06.235714 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-446d6c33-b336-4daa-9d47-353c2863f8f5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:06.236906 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-446d6c33-b336-4daa-9d47-353c2863f8f5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1722 microversion: 2.20 time: 0.152880 Feb 15 14:27:06.237467 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 202/411] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:06 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:06.358774 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-ef406c16-0e28-485b-add1-d2ca15a9a0ba tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:06.359382 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-ef406c16-0e28-485b-add1-d2ca15a9a0ba tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:06.365782 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ef406c16-0e28-485b-add1-d2ca15a9a0ba tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:06.366230 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ef406c16-0e28-485b-add1-d2ca15a9a0ba tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:06.367025 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ef406c16-0e28-485b-add1-d2ca15a9a0ba tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:06.367457 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ef406c16-0e28-485b-add1-d2ca15a9a0ba tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:06.499434 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-ef406c16-0e28-485b-add1-d2ca15a9a0ba tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:06.506691 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-ef406c16-0e28-485b-add1-d2ca15a9a0ba tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 200 len: 1512 microversion: 2.1 time: 0.151539 Feb 15 14:27:06.507264 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 210/412] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:06 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:06.680416 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-6ab07127-0c47-49f6-9599-ab8244d11bce tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:06.681186 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-6ab07127-0c47-49f6-9599-ab8244d11bce tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:06.687067 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6ab07127-0c47-49f6-9599-ab8244d11bce tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:06.687518 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6ab07127-0c47-49f6-9599-ab8244d11bce tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:06.688291 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6ab07127-0c47-49f6-9599-ab8244d11bce tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:06.688761 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6ab07127-0c47-49f6-9599-ab8244d11bce tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:06.822051 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-6ab07127-0c47-49f6-9599-ab8244d11bce tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:06.829211 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-6ab07127-0c47-49f6-9599-ab8244d11bce tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1509 microversion: 2.1 time: 0.152442 Feb 15 14:27:06.829767 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 203/413] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:06 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:07.255207 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-9f109bee-f43a-423a-b229-77500efa445c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:07.255864 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-9f109bee-f43a-423a-b229-77500efa445c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:07.262329 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9f109bee-f43a-423a-b229-77500efa445c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:07.262773 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9f109bee-f43a-423a-b229-77500efa445c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:07.263535 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9f109bee-f43a-423a-b229-77500efa445c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:07.263966 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9f109bee-f43a-423a-b229-77500efa445c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:07.490395 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-9f109bee-f43a-423a-b229-77500efa445c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:07.498239 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-9f109bee-f43a-423a-b229-77500efa445c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:07.499776 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-9f109bee-f43a-423a-b229-77500efa445c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:07.500954 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-9f109bee-f43a-423a-b229-77500efa445c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1722 microversion: 2.20 time: 0.249430 Feb 15 14:27:07.501731 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 211/414] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:07 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:07.522746 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-0fed6d60-fdb3-4738-87a8-b1c08d93ccb7 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:07.523340 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-0fed6d60-fdb3-4738-87a8-b1c08d93ccb7 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:07.530129 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0fed6d60-fdb3-4738-87a8-b1c08d93ccb7 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:07.530578 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0fed6d60-fdb3-4738-87a8-b1c08d93ccb7 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:07.531551 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0fed6d60-fdb3-4738-87a8-b1c08d93ccb7 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:07.531992 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0fed6d60-fdb3-4738-87a8-b1c08d93ccb7 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:07.666545 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-0fed6d60-fdb3-4738-87a8-b1c08d93ccb7 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:07.674451 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-0fed6d60-fdb3-4738-87a8-b1c08d93ccb7 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 200 len: 1512 microversion: 2.1 time: 0.155289 Feb 15 14:27:07.675285 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 204/415] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:07 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:07.840774 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-9c8c674a-7abd-48bf-911a-7590b4d710ea req-69398cb5-6d1d-4cc1-82af-e7da4b640c70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "227a84d4-a09c-4a38-8cdf-f3ddb59bf18c", "name": "network-vif-deleted", "tag": "d7c8d0a9-8af0-4fae-9a63-dc7141d6f1c9"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:27:07.842694 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:27:07.842694 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:27:07.846918 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-a70f6de0-e5e9-4deb-bdc3-4cd7369ed018 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:07.848509 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-a70f6de0-e5e9-4deb-bdc3-4cd7369ed018 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:07.856182 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-9c8c674a-7abd-48bf-911a-7590b4d710ea req-69398cb5-6d1d-4cc1-82af-e7da4b640c70 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:07.860073 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a70f6de0-e5e9-4deb-bdc3-4cd7369ed018 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:07.860668 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a70f6de0-e5e9-4deb-bdc3-4cd7369ed018 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:07.861011 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-9c8c674a-7abd-48bf-911a-7590b4d710ea req-69398cb5-6d1d-4cc1-82af-e7da4b640c70 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:07.861619 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a70f6de0-e5e9-4deb-bdc3-4cd7369ed018 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:07.862305 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a70f6de0-e5e9-4deb-bdc3-4cd7369ed018 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:07.925028 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-9c8c674a-7abd-48bf-911a-7590b4d710ea req-69398cb5-6d1d-4cc1-82af-e7da4b640c70 service nova] Creating event network-vif-deleted:d7c8d0a9-8af0-4fae-9a63-dc7141d6f1c9 for instance 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c on hv-cinder-81914 Feb 15 14:27:07.934686 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-9c8c674a-7abd-48bf-911a-7590b4d710ea req-69398cb5-6d1d-4cc1-82af-e7da4b640c70 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098053 Feb 15 14:27:07.935299 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 212/416] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:27:08.101237 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-a70f6de0-e5e9-4deb-bdc3-4cd7369ed018 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:08.116359 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-a70f6de0-e5e9-4deb-bdc3-4cd7369ed018 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1509 microversion: 2.1 time: 0.273117 Feb 15 14:27:08.127696 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 205/417] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:07 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1509 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:27:08.519706 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-a520ca4a-678c-4f04-9fd0-aac3d590e507 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:08.520911 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-a520ca4a-678c-4f04-9fd0-aac3d590e507 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:08.535244 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a520ca4a-678c-4f04-9fd0-aac3d590e507 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:08.536930 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a520ca4a-678c-4f04-9fd0-aac3d590e507 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:08.537933 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a520ca4a-678c-4f04-9fd0-aac3d590e507 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:08.538750 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a520ca4a-678c-4f04-9fd0-aac3d590e507 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:08.692045 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-93095334-8b9c-4668-b71e-865d6582709b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:08.692825 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-93095334-8b9c-4668-b71e-865d6582709b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:08.700814 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-93095334-8b9c-4668-b71e-865d6582709b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:08.701480 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-93095334-8b9c-4668-b71e-865d6582709b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:08.702436 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-93095334-8b9c-4668-b71e-865d6582709b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:08.703137 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-93095334-8b9c-4668-b71e-865d6582709b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:08.718941 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.wsgi [None req-93095334-8b9c-4668-b71e-865d6582709b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] HTTP exception thrown: Instance 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c could not be found. Feb 15 14:27:08.719594 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-93095334-8b9c-4668-b71e-865d6582709b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Returning 404 to user: Instance 227a84d4-a09c-4a38-8cdf-f3ddb59bf18c could not be found. {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:27:08.720774 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-93095334-8b9c-4668-b71e-865d6582709b tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c" status: 404 len: 111 microversion: 2.1 time: 0.033113 Feb 15 14:27:08.721328 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 206/418] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:08 2022] GET /compute/v2.1/servers/227a84d4-a09c-4a38-8cdf-f3ddb59bf18c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 15 14:27:08.732976 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a520ca4a-678c-4f04-9fd0-aac3d590e507 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:08.746869 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a520ca4a-678c-4f04-9fd0-aac3d590e507 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:08.748385 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a520ca4a-678c-4f04-9fd0-aac3d590e507 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:08.749599 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-a520ca4a-678c-4f04-9fd0-aac3d590e507 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1722 microversion: 2.20 time: 0.234143 Feb 15 14:27:08.750164 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 213/419] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:08 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:09.134865 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-097aa607-0493-42c7-bab5-ef09065142f5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:09.135477 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-097aa607-0493-42c7-bab5-ef09065142f5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:09.141213 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-097aa607-0493-42c7-bab5-ef09065142f5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:09.141661 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-097aa607-0493-42c7-bab5-ef09065142f5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:09.142427 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-097aa607-0493-42c7-bab5-ef09065142f5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:09.142852 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-097aa607-0493-42c7-bab5-ef09065142f5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:09.293178 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-097aa607-0493-42c7-bab5-ef09065142f5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:09.304885 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-097aa607-0493-42c7-bab5-ef09065142f5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1509 microversion: 2.1 time: 0.173648 Feb 15 14:27:09.306407 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 207/420] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:09 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:09.767931 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-688eea48-b51b-414e-98a5-f8c8fa0f2a12 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:09.768569 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-688eea48-b51b-414e-98a5-f8c8fa0f2a12 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:09.776028 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-688eea48-b51b-414e-98a5-f8c8fa0f2a12 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:09.776551 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-688eea48-b51b-414e-98a5-f8c8fa0f2a12 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:09.777337 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-688eea48-b51b-414e-98a5-f8c8fa0f2a12 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:09.777773 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-688eea48-b51b-414e-98a5-f8c8fa0f2a12 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:09.863597 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-e5455fb3-f132-40f3-98bf-f8491c4e29b6 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:09.864136 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-e5455fb3-f132-40f3-98bf-f8491c4e29b6 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:09.870990 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e5455fb3-f132-40f3-98bf-f8491c4e29b6 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:09.871359 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e5455fb3-f132-40f3-98bf-f8491c4e29b6 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:09.872312 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e5455fb3-f132-40f3-98bf-f8491c4e29b6 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:09.872774 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e5455fb3-f132-40f3-98bf-f8491c4e29b6 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:09.900392 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-e5455fb3-f132-40f3-98bf-f8491c4e29b6 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Going to try to terminate instance {{(pid=116362) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 14:27:09.985017 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-e5455fb3-f132-40f3-98bf-f8491c4e29b6 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 204 len: 0 microversion: 2.1 time: 0.125342 Feb 15 14:27:09.985932 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 208/421] 10.222.0.83 () {58 vars in 1238 bytes} [Tue Feb 15 14:27:09 2022] DELETE /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 15 14:27:09.997345 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-5b696b5b-4652-44e5-9322-610851d80973 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:09.998374 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-5b696b5b-4652-44e5-9322-610851d80973 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:10.005219 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-688eea48-b51b-414e-98a5-f8c8fa0f2a12 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:10.006128 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5b696b5b-4652-44e5-9322-610851d80973 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:10.006675 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5b696b5b-4652-44e5-9322-610851d80973 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:10.007533 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5b696b5b-4652-44e5-9322-610851d80973 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:10.008131 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5b696b5b-4652-44e5-9322-610851d80973 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:10.015360 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-688eea48-b51b-414e-98a5-f8c8fa0f2a12 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:10.017094 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-688eea48-b51b-414e-98a5-f8c8fa0f2a12 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:10.018436 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-688eea48-b51b-414e-98a5-f8c8fa0f2a12 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1722 microversion: 2.20 time: 0.254075 Feb 15 14:27:10.028752 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 214/422] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:09 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:10.234955 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-5b696b5b-4652-44e5-9322-610851d80973 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:10.243341 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-5b696b5b-4652-44e5-9322-610851d80973 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 200 len: 1512 microversion: 2.1 time: 0.252751 Feb 15 14:27:10.243997 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 209/423] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:09 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 1512 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:27:10.322814 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-d4d2dcc3-3ea2-477f-8f9b-feb342ce472f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:10.323415 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-d4d2dcc3-3ea2-477f-8f9b-feb342ce472f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:10.329244 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d4d2dcc3-3ea2-477f-8f9b-feb342ce472f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:10.329704 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d4d2dcc3-3ea2-477f-8f9b-feb342ce472f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:10.330540 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d4d2dcc3-3ea2-477f-8f9b-feb342ce472f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:10.330971 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d4d2dcc3-3ea2-477f-8f9b-feb342ce472f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:10.469026 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-d4d2dcc3-3ea2-477f-8f9b-feb342ce472f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:10.477162 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-d4d2dcc3-3ea2-477f-8f9b-feb342ce472f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1515 microversion: 2.1 time: 0.157656 Feb 15 14:27:10.478671 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 215/424] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:10 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:11.038450 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-06c8671b-21ec-4f82-b49f-12ee9f103d21 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:11.039883 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-06c8671b-21ec-4f82-b49f-12ee9f103d21 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:11.047302 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-06c8671b-21ec-4f82-b49f-12ee9f103d21 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:11.047753 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-06c8671b-21ec-4f82-b49f-12ee9f103d21 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:11.048574 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-06c8671b-21ec-4f82-b49f-12ee9f103d21 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:11.049008 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-06c8671b-21ec-4f82-b49f-12ee9f103d21 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:11.262817 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-8e7a8217-00fa-44ad-a143-46c5ee844365 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:11.263625 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-8e7a8217-00fa-44ad-a143-46c5ee844365 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:11.270753 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8e7a8217-00fa-44ad-a143-46c5ee844365 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:11.271365 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8e7a8217-00fa-44ad-a143-46c5ee844365 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:11.272164 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8e7a8217-00fa-44ad-a143-46c5ee844365 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:11.272624 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8e7a8217-00fa-44ad-a143-46c5ee844365 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:11.456821 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-8e7a8217-00fa-44ad-a143-46c5ee844365 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:11.467292 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-8e7a8217-00fa-44ad-a143-46c5ee844365 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 200 len: 1512 microversion: 2.1 time: 0.209916 Feb 15 14:27:11.478977 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 216/425] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:11 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 1512 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:27:11.542845 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-06c8671b-21ec-4f82-b49f-12ee9f103d21 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:11.551171 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-06c8671b-21ec-4f82-b49f-12ee9f103d21 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:11.553528 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-06c8671b-21ec-4f82-b49f-12ee9f103d21 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:11.554875 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-06c8671b-21ec-4f82-b49f-12ee9f103d21 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1722 microversion: 2.20 time: 0.520103 Feb 15 14:27:11.555439 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 210/426] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:11 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1722 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:11.841696 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-b9c7533a-67af-4abc-bd33-dfb3594b5b0f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:11.842591 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-b9c7533a-67af-4abc-bd33-dfb3594b5b0f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:11.848699 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b9c7533a-67af-4abc-bd33-dfb3594b5b0f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:11.849634 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b9c7533a-67af-4abc-bd33-dfb3594b5b0f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:11.850529 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b9c7533a-67af-4abc-bd33-dfb3594b5b0f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:11.851243 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b9c7533a-67af-4abc-bd33-dfb3594b5b0f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:12.031471 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-b9c7533a-67af-4abc-bd33-dfb3594b5b0f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:12.039375 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-b9c7533a-67af-4abc-bd33-dfb3594b5b0f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1515 microversion: 2.1 time: 0.201402 Feb 15 14:27:12.039992 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 217/427] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:11 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1515 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:12.056163 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-e84fef18-4680-4b94-9066-c5ba1e328edc tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d43a941-df96-4136-ba96-541da47001d5"}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:27:12.057254 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-e84fef18-4680-4b94-9066-c5ba1e328edc tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:12.064526 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e84fef18-4680-4b94-9066-c5ba1e328edc tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:12.064991 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e84fef18-4680-4b94-9066-c5ba1e328edc tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:12.065789 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e84fef18-4680-4b94-9066-c5ba1e328edc tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:12.066228 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e84fef18-4680-4b94-9066-c5ba1e328edc tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:12.387794 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-e84fef18-4680-4b94-9066-c5ba1e328edc tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "POST /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335297 Feb 15 14:27:12.388564 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 211/428] 10.222.0.83 () {60 vars in 1322 bytes} [Tue Feb 15 14:27:12 2022] POST /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:27:12.486158 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-a6e31f6e-e697-47f2-94ae-f8cec941dd53 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:12.486872 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-a6e31f6e-e697-47f2-94ae-f8cec941dd53 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:12.495358 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a6e31f6e-e697-47f2-94ae-f8cec941dd53 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:12.495814 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a6e31f6e-e697-47f2-94ae-f8cec941dd53 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:12.496655 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a6e31f6e-e697-47f2-94ae-f8cec941dd53 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:12.497095 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a6e31f6e-e697-47f2-94ae-f8cec941dd53 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:12.579941 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-00667e76-b86b-4fe8-8fd5-2ac4895145f2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:12.580678 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-00667e76-b86b-4fe8-8fd5-2ac4895145f2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:12.591054 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-00667e76-b86b-4fe8-8fd5-2ac4895145f2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:12.591503 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-00667e76-b86b-4fe8-8fd5-2ac4895145f2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:12.596544 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-00667e76-b86b-4fe8-8fd5-2ac4895145f2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:12.598257 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-00667e76-b86b-4fe8-8fd5-2ac4895145f2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:12.786002 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a6e31f6e-e697-47f2-94ae-f8cec941dd53 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:12.797965 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-a6e31f6e-e697-47f2-94ae-f8cec941dd53 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 200 len: 1512 microversion: 2.1 time: 0.315275 Feb 15 14:27:12.808169 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 218/429] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:12 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 1512 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:12.987454 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-00667e76-b86b-4fe8-8fd5-2ac4895145f2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:12.996517 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-00667e76-b86b-4fe8-8fd5-2ac4895145f2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:12.998041 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-00667e76-b86b-4fe8-8fd5-2ac4895145f2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:12.999309 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-00667e76-b86b-4fe8-8fd5-2ac4895145f2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1722 microversion: 2.20 time: 0.429218 Feb 15 14:27:12.999877 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 212/430] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:12 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1722 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 14:27:13.815268 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-dd6841e1-2ec3-41c9-ad75-3836178540f3 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:13.816631 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-dd6841e1-2ec3-41c9-ad75-3836178540f3 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:13.830838 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dd6841e1-2ec3-41c9-ad75-3836178540f3 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:13.831613 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dd6841e1-2ec3-41c9-ad75-3836178540f3 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:13.835542 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dd6841e1-2ec3-41c9-ad75-3836178540f3 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:13.836096 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-dd6841e1-2ec3-41c9-ad75-3836178540f3 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:14.017554 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-3ec3fc70-9009-456f-aed3-e4b463ec05f6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:14.018300 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-3ec3fc70-9009-456f-aed3-e4b463ec05f6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:14.025530 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3ec3fc70-9009-456f-aed3-e4b463ec05f6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:14.026304 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3ec3fc70-9009-456f-aed3-e4b463ec05f6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:14.027589 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3ec3fc70-9009-456f-aed3-e4b463ec05f6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:14.028134 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3ec3fc70-9009-456f-aed3-e4b463ec05f6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:14.285791 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-dd6841e1-2ec3-41c9-ad75-3836178540f3 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:14.307455 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-dd6841e1-2ec3-41c9-ad75-3836178540f3 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 200 len: 1512 microversion: 2.1 time: 0.493048 Feb 15 14:27:14.307974 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 219/431] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:13 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 1512 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:14.321338 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-5b70c006-9981-4365-8f96-4b08dceb3d51 req-0f57ed7b-8da1-413d-bb03-0a7d94e62745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a72c673c-5d13-4e5f-9372-4978fa30606e", "name": "network-vif-deleted", "tag": "5a742ca0-cc9c-45f2-8721-966fe2c2f900"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:27:14.323943 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:27:14.323943 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:27:14.345793 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-5b70c006-9981-4365-8f96-4b08dceb3d51 req-0f57ed7b-8da1-413d-bb03-0a7d94e62745 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:14.346737 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-5b70c006-9981-4365-8f96-4b08dceb3d51 req-0f57ed7b-8da1-413d-bb03-0a7d94e62745 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:14.364469 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-5b70c006-9981-4365-8f96-4b08dceb3d51 req-0f57ed7b-8da1-413d-bb03-0a7d94e62745 service nova] Creating event network-vif-deleted:5a742ca0-cc9c-45f2-8721-966fe2c2f900 for instance a72c673c-5d13-4e5f-9372-4978fa30606e on hv-cinder-81914 Feb 15 14:27:14.370860 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-5b70c006-9981-4365-8f96-4b08dceb3d51 req-0f57ed7b-8da1-413d-bb03-0a7d94e62745 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059896 Feb 15 14:27:14.372186 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 220/432] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:27:14.687909 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-3ec3fc70-9009-456f-aed3-e4b463ec05f6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:14.698067 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-3ec3fc70-9009-456f-aed3-e4b463ec05f6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:14.699883 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-3ec3fc70-9009-456f-aed3-e4b463ec05f6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:14.701380 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-3ec3fc70-9009-456f-aed3-e4b463ec05f6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1722 microversion: 2.20 time: 0.687867 Feb 15 14:27:14.702057 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 213/433] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:14 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1722 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:15.325098 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-ea63a12e-1e78-48d2-a814-206474976b13 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:15.325800 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-ea63a12e-1e78-48d2-a814-206474976b13 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: a72c673c-5d13-4e5f-9372-4978fa30606e] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:15.332452 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ea63a12e-1e78-48d2-a814-206474976b13 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:15.333219 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ea63a12e-1e78-48d2-a814-206474976b13 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:15.334421 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ea63a12e-1e78-48d2-a814-206474976b13 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:15.334932 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ea63a12e-1e78-48d2-a814-206474976b13 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:15.349568 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.wsgi [None req-ea63a12e-1e78-48d2-a814-206474976b13 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] HTTP exception thrown: Instance a72c673c-5d13-4e5f-9372-4978fa30606e could not be found. Feb 15 14:27:15.356606 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-ea63a12e-1e78-48d2-a814-206474976b13 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Returning 404 to user: Instance a72c673c-5d13-4e5f-9372-4978fa30606e could not be found. {{(pid=116363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:27:15.357557 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-ea63a12e-1e78-48d2-a814-206474976b13 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e" status: 404 len: 111 microversion: 2.1 time: 0.037033 Feb 15 14:27:15.358304 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 221/434] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:15 2022] GET /compute/v2.1/servers/a72c673c-5d13-4e5f-9372-4978fa30606e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:27:15.366208 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-3f12cd3f-b1a8-42af-be53-876b61a0e1b7 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:15.366717 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-3f12cd3f-b1a8-42af-be53-876b61a0e1b7 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:15.373478 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3f12cd3f-b1a8-42af-be53-876b61a0e1b7 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:15.374170 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3f12cd3f-b1a8-42af-be53-876b61a0e1b7 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:15.374965 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3f12cd3f-b1a8-42af-be53-876b61a0e1b7 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:15.375401 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3f12cd3f-b1a8-42af-be53-876b61a0e1b7 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:15.402036 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-3f12cd3f-b1a8-42af-be53-876b61a0e1b7 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] Going to try to terminate instance {{(pid=116362) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 14:27:15.485635 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-3f12cd3f-b1a8-42af-be53-876b61a0e1b7 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "DELETE /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57" status: 204 len: 0 microversion: 2.1 time: 0.121097 Feb 15 14:27:15.488467 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 214/435] 10.222.0.83 () {58 vars in 1238 bytes} [Tue Feb 15 14:27:15 2022] DELETE /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 14:27:15.497293 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-87607377-6ff6-472d-b9f2-83c1a8ddc8a2 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:15.497902 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-87607377-6ff6-472d-b9f2-83c1a8ddc8a2 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:15.508646 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-87607377-6ff6-472d-b9f2-83c1a8ddc8a2 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:15.511507 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-87607377-6ff6-472d-b9f2-83c1a8ddc8a2 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:15.512578 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-87607377-6ff6-472d-b9f2-83c1a8ddc8a2 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:15.513226 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-87607377-6ff6-472d-b9f2-83c1a8ddc8a2 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:15.728220 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-4953f4ce-9dbd-445d-8269-25e909bd1ac5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:15.728373 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-87607377-6ff6-472d-b9f2-83c1a8ddc8a2 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:15.729305 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-4953f4ce-9dbd-445d-8269-25e909bd1ac5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:15.736803 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-87607377-6ff6-472d-b9f2-83c1a8ddc8a2 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57" status: 200 len: 1514 microversion: 2.1 time: 0.244028 Feb 15 14:27:15.740335 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4953f4ce-9dbd-445d-8269-25e909bd1ac5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:15.740926 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4953f4ce-9dbd-445d-8269-25e909bd1ac5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:15.741724 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4953f4ce-9dbd-445d-8269-25e909bd1ac5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:15.742161 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4953f4ce-9dbd-445d-8269-25e909bd1ac5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:15.753231 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 222/436] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:15 2022] GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57 => generated 1514 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:15.905120 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-4953f4ce-9dbd-445d-8269-25e909bd1ac5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:15.915635 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-4953f4ce-9dbd-445d-8269-25e909bd1ac5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:15.917577 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-4953f4ce-9dbd-445d-8269-25e909bd1ac5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:15.919268 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-4953f4ce-9dbd-445d-8269-25e909bd1ac5 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1722 microversion: 2.20 time: 0.196333 Feb 15 14:27:15.930987 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 215/437] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:15 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 14:27:16.771251 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-c4126e0d-dc50-4ab0-a431-09a372a3596c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:16.772656 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-c4126e0d-dc50-4ab0-a431-09a372a3596c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:16.780937 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c4126e0d-dc50-4ab0-a431-09a372a3596c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:16.781473 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c4126e0d-dc50-4ab0-a431-09a372a3596c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:16.782331 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c4126e0d-dc50-4ab0-a431-09a372a3596c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:16.782937 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c4126e0d-dc50-4ab0-a431-09a372a3596c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:16.929292 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-c4126e0d-dc50-4ab0-a431-09a372a3596c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:16.937170 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-c4126e0d-dc50-4ab0-a431-09a372a3596c tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57" status: 200 len: 1514 microversion: 2.1 time: 0.180421 Feb 15 14:27:16.938299 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 223/438] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:16 2022] GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:16.942540 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-13afe6ba-5b4a-407e-90fa-4239ad2ddc18 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:16.943408 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-13afe6ba-5b4a-407e-90fa-4239ad2ddc18 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:16.952339 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-13afe6ba-5b4a-407e-90fa-4239ad2ddc18 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:16.953347 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-13afe6ba-5b4a-407e-90fa-4239ad2ddc18 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:16.954306 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-13afe6ba-5b4a-407e-90fa-4239ad2ddc18 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:16.954746 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-13afe6ba-5b4a-407e-90fa-4239ad2ddc18 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:17.194360 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-13afe6ba-5b4a-407e-90fa-4239ad2ddc18 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:17.204517 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-13afe6ba-5b4a-407e-90fa-4239ad2ddc18 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:17.206324 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-13afe6ba-5b4a-407e-90fa-4239ad2ddc18 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:17.207612 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-13afe6ba-5b4a-407e-90fa-4239ad2ddc18 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1722 microversion: 2.20 time: 0.269819 Feb 15 14:27:17.209045 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 216/439] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:16 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:17.959502 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-13a6ae02-5f33-47aa-bd4e-3fdd66a68982 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:17.962265 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-13a6ae02-5f33-47aa-bd4e-3fdd66a68982 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:17.975571 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-13a6ae02-5f33-47aa-bd4e-3fdd66a68982 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:17.976337 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-13a6ae02-5f33-47aa-bd4e-3fdd66a68982 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:17.978573 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-13a6ae02-5f33-47aa-bd4e-3fdd66a68982 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:17.979247 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-13a6ae02-5f33-47aa-bd4e-3fdd66a68982 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:18.228571 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-04f15a37-51c6-4f2c-95e2-6ca3d0f91c14 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:18.230014 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-04f15a37-51c6-4f2c-95e2-6ca3d0f91c14 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:18.242293 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-04f15a37-51c6-4f2c-95e2-6ca3d0f91c14 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:18.242818 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-04f15a37-51c6-4f2c-95e2-6ca3d0f91c14 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:18.243845 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-04f15a37-51c6-4f2c-95e2-6ca3d0f91c14 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:18.244287 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-04f15a37-51c6-4f2c-95e2-6ca3d0f91c14 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:18.338972 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-13a6ae02-5f33-47aa-bd4e-3fdd66a68982 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:18.350818 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-13a6ae02-5f33-47aa-bd4e-3fdd66a68982 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57" status: 200 len: 1514 microversion: 2.1 time: 0.398825 Feb 15 14:27:18.351961 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 224/440] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:17 2022] GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57 => generated 1514 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:18.912109 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-4d7e9b32-9b82-4311-a2d3-3f15088802ad req-8741c263-8d1b-4798-861e-38759964c45f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949b517a-36a2-4f77-bf15-8ed3c1cfaf57", "name": "network-vif-deleted", "tag": "391f41ba-b06d-4edb-9881-4d4c52a864ad"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:27:18.915015 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:27:18.915015 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:27:18.948211 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-4d7e9b32-9b82-4311-a2d3-3f15088802ad req-8741c263-8d1b-4798-861e-38759964c45f service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:18.948749 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-4d7e9b32-9b82-4311-a2d3-3f15088802ad req-8741c263-8d1b-4798-861e-38759964c45f service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:18.995931 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-4d7e9b32-9b82-4311-a2d3-3f15088802ad req-8741c263-8d1b-4798-861e-38759964c45f service nova] Creating event network-vif-deleted:391f41ba-b06d-4edb-9881-4d4c52a864ad for instance 949b517a-36a2-4f77-bf15-8ed3c1cfaf57 on hv-cinder-81914 Feb 15 14:27:19.005943 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-4d7e9b32-9b82-4311-a2d3-3f15088802ad req-8741c263-8d1b-4798-861e-38759964c45f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101592 Feb 15 14:27:19.015074 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 225/441] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:27:19.063013 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-04f15a37-51c6-4f2c-95e2-6ca3d0f91c14 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:19.074406 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-04f15a37-51c6-4f2c-95e2-6ca3d0f91c14 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:19.076256 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-04f15a37-51c6-4f2c-95e2-6ca3d0f91c14 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:19.079630 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-04f15a37-51c6-4f2c-95e2-6ca3d0f91c14 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1722 microversion: 2.20 time: 0.856688 Feb 15 14:27:19.082096 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 217/442] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:18 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1722 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 14:27:19.379607 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-0ff3764b-89e1-4095-b4a2-6f7e5052f60d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:19.380478 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-0ff3764b-89e1-4095-b4a2-6f7e5052f60d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:19.390312 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0ff3764b-89e1-4095-b4a2-6f7e5052f60d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:19.392977 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0ff3764b-89e1-4095-b4a2-6f7e5052f60d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:19.393951 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0ff3764b-89e1-4095-b4a2-6f7e5052f60d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:19.400819 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0ff3764b-89e1-4095-b4a2-6f7e5052f60d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:19.493978 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0ff3764b-89e1-4095-b4a2-6f7e5052f60d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:19.509746 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0ff3764b-89e1-4095-b4a2-6f7e5052f60d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:19.510360 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.objects.instance [None req-0ff3764b-89e1-4095-b4a2-6f7e5052f60d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lazy-loading 'fault' on Instance uuid 949b517a-36a2-4f77-bf15-8ed3c1cfaf57 {{(pid=116363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:27:19.589628 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-0ff3764b-89e1-4095-b4a2-6f7e5052f60d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:19.611491 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-0ff3764b-89e1-4095-b4a2-6f7e5052f60d tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57" status: 200 len: 1308 microversion: 2.1 time: 0.236070 Feb 15 14:27:19.612543 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 226/443] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:19 2022] GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57 => generated 1308 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:20.103400 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-4fd0286f-e306-4b9b-809f-a169990d31d6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:20.104707 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-4fd0286f-e306-4b9b-809f-a169990d31d6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:20.111804 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4fd0286f-e306-4b9b-809f-a169990d31d6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:20.112467 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4fd0286f-e306-4b9b-809f-a169990d31d6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:20.125339 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4fd0286f-e306-4b9b-809f-a169990d31d6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:20.128975 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4fd0286f-e306-4b9b-809f-a169990d31d6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:20.316600 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-bdffcd1c-3b52-4556-aadb-021b3f138905 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:27:20.317567 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-bdffcd1c-3b52-4556-aadb-021b3f138905 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:20.330126 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bdffcd1c-3b52-4556-aadb-021b3f138905 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:20.330588 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bdffcd1c-3b52-4556-aadb-021b3f138905 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:20.331388 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bdffcd1c-3b52-4556-aadb-021b3f138905 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:20.331837 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bdffcd1c-3b52-4556-aadb-021b3f138905 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:20.370948 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.objects.instance [None req-bdffcd1c-3b52-4556-aadb-021b3f138905 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lazy-loading 'flavor' on Instance uuid 13edf4fd-20da-43ce-bb58-5757dc0f96c7 {{(pid=116363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:27:20.544726 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-4fd0286f-e306-4b9b-809f-a169990d31d6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:20.582198 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-4fd0286f-e306-4b9b-809f-a169990d31d6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:20.585408 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-4fd0286f-e306-4b9b-809f-a169990d31d6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:20.587480 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-4fd0286f-e306-4b9b-809f-a169990d31d6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1722 microversion: 2.20 time: 0.491828 Feb 15 14:27:20.588057 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 218/444] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:20 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1722 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:20.632506 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-bdffcd1c-3b52-4556-aadb-021b3f138905 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "POST /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/action" status: 200 len: 32 microversion: 2.1 time: 0.318275 Feb 15 14:27:20.633679 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 227/445] 10.222.0.83 () {60 vars in 1277 bytes} [Tue Feb 15 14:27:20 2022] POST /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/action => generated 32 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 15 14:27:20.643729 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-b70ce049-df13-43d2-8f95-80ff4fee3624 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:20.646405 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-b70ce049-df13-43d2-8f95-80ff4fee3624 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 949b517a-36a2-4f77-bf15-8ed3c1cfaf57] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:20.653072 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-49f9a7ec-6f19-4368-9281-821fe03a979d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:20.655554 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-49f9a7ec-6f19-4368-9281-821fe03a979d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:20.656694 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b70ce049-df13-43d2-8f95-80ff4fee3624 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:20.657245 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b70ce049-df13-43d2-8f95-80ff4fee3624 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:20.658522 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b70ce049-df13-43d2-8f95-80ff4fee3624 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:20.659547 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b70ce049-df13-43d2-8f95-80ff4fee3624 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:20.671409 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-49f9a7ec-6f19-4368-9281-821fe03a979d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:20.673310 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-49f9a7ec-6f19-4368-9281-821fe03a979d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:20.674795 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-49f9a7ec-6f19-4368-9281-821fe03a979d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:20.676949 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-49f9a7ec-6f19-4368-9281-821fe03a979d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:20.678869 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.wsgi [None req-b70ce049-df13-43d2-8f95-80ff4fee3624 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] HTTP exception thrown: Instance 949b517a-36a2-4f77-bf15-8ed3c1cfaf57 could not be found. Feb 15 14:27:20.679995 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-b70ce049-df13-43d2-8f95-80ff4fee3624 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Returning 404 to user: Instance 949b517a-36a2-4f77-bf15-8ed3c1cfaf57 could not be found. {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:27:20.680976 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-b70ce049-df13-43d2-8f95-80ff4fee3624 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57" status: 404 len: 111 microversion: 2.1 time: 0.052859 Feb 15 14:27:20.688849 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 219/446] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:20 2022] GET /compute/v2.1/servers/949b517a-36a2-4f77-bf15-8ed3c1cfaf57 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:27:21.041252 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-49f9a7ec-6f19-4368-9281-821fe03a979d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:21.053104 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-49f9a7ec-6f19-4368-9281-821fe03a979d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.411240 Feb 15 14:27:21.057249 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 228/447] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:20 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:21.614575 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-26066342-c3fc-4833-aed3-7f43344b3c51 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:21.615988 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-26066342-c3fc-4833-aed3-7f43344b3c51 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:21.643813 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-26066342-c3fc-4833-aed3-7f43344b3c51 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:21.644711 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-26066342-c3fc-4833-aed3-7f43344b3c51 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:21.645868 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-26066342-c3fc-4833-aed3-7f43344b3c51 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:21.646635 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-26066342-c3fc-4833-aed3-7f43344b3c51 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:21.907369 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-26066342-c3fc-4833-aed3-7f43344b3c51 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:21.917630 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-26066342-c3fc-4833-aed3-7f43344b3c51 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:21.919746 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-26066342-c3fc-4833-aed3-7f43344b3c51 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:21.921179 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-26066342-c3fc-4833-aed3-7f43344b3c51 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1722 microversion: 2.20 time: 0.319108 Feb 15 14:27:21.922451 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 220/448] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:21 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1722 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:21.941521 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-a014a292-6775-4050-8996-781737bac15e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:21.942190 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-a014a292-6775-4050-8996-781737bac15e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:21.950579 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a014a292-6775-4050-8996-781737bac15e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:21.951031 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a014a292-6775-4050-8996-781737bac15e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:21.951834 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a014a292-6775-4050-8996-781737bac15e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:21.952265 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a014a292-6775-4050-8996-781737bac15e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:21.982759 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-a014a292-6775-4050-8996-781737bac15e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Going to try to terminate instance {{(pid=116363) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 14:27:22.075902 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-c75aecf0-15e2-4285-8300-fd9586106dee tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:22.077328 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-c75aecf0-15e2-4285-8300-fd9586106dee tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:22.085320 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c75aecf0-15e2-4285-8300-fd9586106dee tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:22.085767 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c75aecf0-15e2-4285-8300-fd9586106dee tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:22.088030 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c75aecf0-15e2-4285-8300-fd9586106dee tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:22.091318 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c75aecf0-15e2-4285-8300-fd9586106dee tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:22.127807 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-a014a292-6775-4050-8996-781737bac15e tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "DELETE /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 204 len: 0 microversion: 2.1 time: 0.190099 Feb 15 14:27:22.131820 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 229/449] 10.222.0.83 () {58 vars in 1238 bytes} [Tue Feb 15 14:27:21 2022] DELETE /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 14:27:22.137588 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-2996028d-0e98-4a0a-9c0a-6db1141ab9da tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:22.138517 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-2996028d-0e98-4a0a-9c0a-6db1141ab9da tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:22.150554 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2996028d-0e98-4a0a-9c0a-6db1141ab9da tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:22.151099 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2996028d-0e98-4a0a-9c0a-6db1141ab9da tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:22.151964 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2996028d-0e98-4a0a-9c0a-6db1141ab9da tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:22.152502 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2996028d-0e98-4a0a-9c0a-6db1141ab9da tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:22.359028 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-2996028d-0e98-4a0a-9c0a-6db1141ab9da tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:22.366523 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-2996028d-0e98-4a0a-9c0a-6db1141ab9da tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 200 len: 1513 microversion: 2.1 time: 0.233212 Feb 15 14:27:22.377240 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 230/450] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:22 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 1513 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:22.433022 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-c75aecf0-15e2-4285-8300-fd9586106dee tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:22.442878 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-c75aecf0-15e2-4285-8300-fd9586106dee tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.374686 Feb 15 14:27:22.453001 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 221/451] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:22 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:22.938958 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-e2be9492-7548-4df3-9006-0201e8bb7922 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:22.939563 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-e2be9492-7548-4df3-9006-0201e8bb7922 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:22.946581 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e2be9492-7548-4df3-9006-0201e8bb7922 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:22.947656 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e2be9492-7548-4df3-9006-0201e8bb7922 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:22.948633 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e2be9492-7548-4df3-9006-0201e8bb7922 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:22.949072 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e2be9492-7548-4df3-9006-0201e8bb7922 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:23.114797 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-e2be9492-7548-4df3-9006-0201e8bb7922 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:23.134115 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-e2be9492-7548-4df3-9006-0201e8bb7922 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:23.135877 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-e2be9492-7548-4df3-9006-0201e8bb7922 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:23.137274 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-e2be9492-7548-4df3-9006-0201e8bb7922 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1722 microversion: 2.20 time: 0.201992 Feb 15 14:27:23.138135 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 231/452] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:22 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:23.385118 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-d6491315-3ef6-476a-867b-93b6d49930aa tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:23.386708 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-d6491315-3ef6-476a-867b-93b6d49930aa tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:23.394262 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d6491315-3ef6-476a-867b-93b6d49930aa tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:23.395114 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d6491315-3ef6-476a-867b-93b6d49930aa tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:23.397080 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d6491315-3ef6-476a-867b-93b6d49930aa tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:23.397687 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d6491315-3ef6-476a-867b-93b6d49930aa tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:23.460057 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-0716aa86-49c7-4d25-b438-d8abc8820021 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:23.460922 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-0716aa86-49c7-4d25-b438-d8abc8820021 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:23.470208 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0716aa86-49c7-4d25-b438-d8abc8820021 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:23.474244 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0716aa86-49c7-4d25-b438-d8abc8820021 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:23.475140 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0716aa86-49c7-4d25-b438-d8abc8820021 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:23.475596 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0716aa86-49c7-4d25-b438-d8abc8820021 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:23.660195 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-d6491315-3ef6-476a-867b-93b6d49930aa tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:23.669490 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-d6491315-3ef6-476a-867b-93b6d49930aa tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 200 len: 1513 microversion: 2.1 time: 0.288961 Feb 15 14:27:23.679642 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 222/453] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:23 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 1513 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:23.718647 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-0716aa86-49c7-4d25-b438-d8abc8820021 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:23.729198 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-0716aa86-49c7-4d25-b438-d8abc8820021 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.272783 Feb 15 14:27:23.730393 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 232/454] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:23 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:24.159873 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-8bd663a0-4898-4545-95ed-e7b3cf42c07b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:24.160745 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-8bd663a0-4898-4545-95ed-e7b3cf42c07b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:24.176017 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8bd663a0-4898-4545-95ed-e7b3cf42c07b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:24.179343 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8bd663a0-4898-4545-95ed-e7b3cf42c07b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:24.180885 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8bd663a0-4898-4545-95ed-e7b3cf42c07b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:24.185272 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8bd663a0-4898-4545-95ed-e7b3cf42c07b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:24.423114 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-8bd663a0-4898-4545-95ed-e7b3cf42c07b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:24.437004 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-8bd663a0-4898-4545-95ed-e7b3cf42c07b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:24.438781 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-8bd663a0-4898-4545-95ed-e7b3cf42c07b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:24.440157 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-8bd663a0-4898-4545-95ed-e7b3cf42c07b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1722 microversion: 2.20 time: 0.288405 Feb 15 14:27:24.451391 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 223/455] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:24 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1722 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:24.686360 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-47a6a080-5da3-4840-8963-92c912ce6a63 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:24.687539 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-47a6a080-5da3-4840-8963-92c912ce6a63 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:24.704847 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-47a6a080-5da3-4840-8963-92c912ce6a63 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:24.705562 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-47a6a080-5da3-4840-8963-92c912ce6a63 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:24.706369 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-47a6a080-5da3-4840-8963-92c912ce6a63 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:24.706809 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-47a6a080-5da3-4840-8963-92c912ce6a63 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:24.748744 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-2d45cd53-b758-4540-83e1-e04517d3b951 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:24.749870 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-2d45cd53-b758-4540-83e1-e04517d3b951 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:24.767236 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2d45cd53-b758-4540-83e1-e04517d3b951 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:24.782176 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2d45cd53-b758-4540-83e1-e04517d3b951 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:24.783424 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2d45cd53-b758-4540-83e1-e04517d3b951 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:24.783878 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2d45cd53-b758-4540-83e1-e04517d3b951 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:24.905303 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-47a6a080-5da3-4840-8963-92c912ce6a63 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:24.919891 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-47a6a080-5da3-4840-8963-92c912ce6a63 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 200 len: 1513 microversion: 2.1 time: 0.237079 Feb 15 14:27:24.921213 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 233/456] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:24 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:25.211354 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-2d45cd53-b758-4540-83e1-e04517d3b951 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:25.224550 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-2d45cd53-b758-4540-83e1-e04517d3b951 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.480150 Feb 15 14:27:25.225391 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 224/457] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:24 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:27:25.460176 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-63e02a57-3845-45a3-9f96-881ae1d5512b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:25.462050 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-63e02a57-3845-45a3-9f96-881ae1d5512b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:25.469374 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-63e02a57-3845-45a3-9f96-881ae1d5512b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:25.470415 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-63e02a57-3845-45a3-9f96-881ae1d5512b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:25.471426 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-63e02a57-3845-45a3-9f96-881ae1d5512b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:25.472432 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-63e02a57-3845-45a3-9f96-881ae1d5512b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:25.662966 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-972c9213-af0b-423c-9478-cd5b90a71fbd req-2ade095a-bd47-44e8-84b3-1565e82e4c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d6c38be-13a5-4c57-badb-c4371acfb34c", "name": "network-vif-deleted", "tag": "7733954e-5190-40f9-8b4f-c132526b121a"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:27:25.668158 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:27:25.668158 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:27:25.682971 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-972c9213-af0b-423c-9478-cd5b90a71fbd req-2ade095a-bd47-44e8-84b3-1565e82e4c4a service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:25.683783 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-972c9213-af0b-423c-9478-cd5b90a71fbd req-2ade095a-bd47-44e8-84b3-1565e82e4c4a service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:25.701960 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-972c9213-af0b-423c-9478-cd5b90a71fbd req-2ade095a-bd47-44e8-84b3-1565e82e4c4a service nova] Creating event network-vif-deleted:7733954e-5190-40f9-8b4f-c132526b121a for instance 2d6c38be-13a5-4c57-badb-c4371acfb34c on hv-cinder-81914 Feb 15 14:27:25.702678 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-63e02a57-3845-45a3-9f96-881ae1d5512b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:25.709485 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-972c9213-af0b-423c-9478-cd5b90a71fbd req-2ade095a-bd47-44e8-84b3-1565e82e4c4a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058427 Feb 15 14:27:25.710935 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 225/458] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:27:25.713203 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-63e02a57-3845-45a3-9f96-881ae1d5512b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:25.714859 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-63e02a57-3845-45a3-9f96-881ae1d5512b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:25.716141 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-63e02a57-3845-45a3-9f96-881ae1d5512b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1722 microversion: 2.20 time: 0.261453 Feb 15 14:27:25.716738 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 234/459] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:25 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:25.939059 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-c75f44da-17e4-4eb3-b7dd-f0db23c212f9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:25.939766 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-c75f44da-17e4-4eb3-b7dd-f0db23c212f9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:25.948685 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c75f44da-17e4-4eb3-b7dd-f0db23c212f9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:25.949140 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c75f44da-17e4-4eb3-b7dd-f0db23c212f9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:25.949943 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c75f44da-17e4-4eb3-b7dd-f0db23c212f9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:25.950385 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c75f44da-17e4-4eb3-b7dd-f0db23c212f9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:25.990280 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c75f44da-17e4-4eb3-b7dd-f0db23c212f9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:25.990947 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c75f44da-17e4-4eb3-b7dd-f0db23c212f9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:25.991567 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.objects.instance [None req-c75f44da-17e4-4eb3-b7dd-f0db23c212f9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lazy-loading 'fault' on Instance uuid 2d6c38be-13a5-4c57-badb-c4371acfb34c {{(pid=116362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:27:26.042046 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-c75f44da-17e4-4eb3-b7dd-f0db23c212f9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b50593d13054c9c8fdf463566f36b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b003f1ecbf4e4a32a99159d5b18a98ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:26.050638 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-c75f44da-17e4-4eb3-b7dd-f0db23c212f9 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 200 len: 1308 microversion: 2.1 time: 0.115511 Feb 15 14:27:26.061701 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 226/460] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:25 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 1308 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:26.244767 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-a2571b6b-4e4a-44f6-a0fc-36c5906c0101 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:26.245456 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-a2571b6b-4e4a-44f6-a0fc-36c5906c0101 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:26.254013 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a2571b6b-4e4a-44f6-a0fc-36c5906c0101 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:26.254472 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a2571b6b-4e4a-44f6-a0fc-36c5906c0101 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:26.256616 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a2571b6b-4e4a-44f6-a0fc-36c5906c0101 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:26.257232 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a2571b6b-4e4a-44f6-a0fc-36c5906c0101 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:26.453661 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a2571b6b-4e4a-44f6-a0fc-36c5906c0101 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:26.463921 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-a2571b6b-4e4a-44f6-a0fc-36c5906c0101 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.225089 Feb 15 14:27:26.464792 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 235/461] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:26 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:26.733978 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-d0084e62-378f-4a0c-a6b5-2cc3a57aaf46 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:26.735413 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-d0084e62-378f-4a0c-a6b5-2cc3a57aaf46 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:26.741558 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d0084e62-378f-4a0c-a6b5-2cc3a57aaf46 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:26.741916 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d0084e62-378f-4a0c-a6b5-2cc3a57aaf46 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:26.743213 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d0084e62-378f-4a0c-a6b5-2cc3a57aaf46 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:26.743679 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d0084e62-378f-4a0c-a6b5-2cc3a57aaf46 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:26.894698 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-d0084e62-378f-4a0c-a6b5-2cc3a57aaf46 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:26.906724 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-d0084e62-378f-4a0c-a6b5-2cc3a57aaf46 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:26.908947 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-d0084e62-378f-4a0c-a6b5-2cc3a57aaf46 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:26.910100 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-d0084e62-378f-4a0c-a6b5-2cc3a57aaf46 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1743 microversion: 2.20 time: 0.179891 Feb 15 14:27:26.913024 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 227/462] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:26 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1743 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:27.068469 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-e36d7700-37f1-4d48-b10c-4e2fa171b795 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:27.069005 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-e36d7700-37f1-4d48-b10c-4e2fa171b795 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] [instance: 2d6c38be-13a5-4c57-badb-c4371acfb34c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:27.075957 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e36d7700-37f1-4d48-b10c-4e2fa171b795 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:27.076427 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e36d7700-37f1-4d48-b10c-4e2fa171b795 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:27.077201 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e36d7700-37f1-4d48-b10c-4e2fa171b795 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:27.077641 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e36d7700-37f1-4d48-b10c-4e2fa171b795 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:27.097163 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.wsgi [None req-e36d7700-37f1-4d48-b10c-4e2fa171b795 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] HTTP exception thrown: Instance 2d6c38be-13a5-4c57-badb-c4371acfb34c could not be found. Feb 15 14:27:27.097918 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-e36d7700-37f1-4d48-b10c-4e2fa171b795 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] Returning 404 to user: Instance 2d6c38be-13a5-4c57-badb-c4371acfb34c could not be found. {{(pid=116363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:27:27.098752 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-e36d7700-37f1-4d48-b10c-4e2fa171b795 tempest-AttachVolumeNegativeTest-1906816670 tempest-AttachVolumeNegativeTest-1906816670-project] 10.222.0.83 "GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c" status: 404 len: 111 microversion: 2.1 time: 0.034079 Feb 15 14:27:27.099826 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 236/463] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:27 2022] GET /compute/v2.1/servers/2d6c38be-13a5-4c57-badb-c4371acfb34c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:27:27.481112 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-d48d43b2-f644-4075-a0c7-9f900966b9ba tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:27.482024 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-d48d43b2-f644-4075-a0c7-9f900966b9ba tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:27.489168 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d48d43b2-f644-4075-a0c7-9f900966b9ba tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:27.489946 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d48d43b2-f644-4075-a0c7-9f900966b9ba tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:27.490815 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d48d43b2-f644-4075-a0c7-9f900966b9ba tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:27.491488 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d48d43b2-f644-4075-a0c7-9f900966b9ba tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:27.778802 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-d48d43b2-f644-4075-a0c7-9f900966b9ba tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:27.787125 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-d48d43b2-f644-4075-a0c7-9f900966b9ba tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.309922 Feb 15 14:27:27.800359 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 228/464] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:27 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:27.931031 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-0581cb0c-a839-4d70-8bef-1c33d4e19c57 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:27.931681 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-0581cb0c-a839-4d70-8bef-1c33d4e19c57 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:27.939988 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0581cb0c-a839-4d70-8bef-1c33d4e19c57 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:27.941108 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0581cb0c-a839-4d70-8bef-1c33d4e19c57 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:27.945015 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0581cb0c-a839-4d70-8bef-1c33d4e19c57 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:27.947084 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0581cb0c-a839-4d70-8bef-1c33d4e19c57 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:28.115544 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-0581cb0c-a839-4d70-8bef-1c33d4e19c57 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:28.131758 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-0581cb0c-a839-4d70-8bef-1c33d4e19c57 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:28.137352 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-0581cb0c-a839-4d70-8bef-1c33d4e19c57 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:28.141693 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-0581cb0c-a839-4d70-8bef-1c33d4e19c57 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1743 microversion: 2.20 time: 0.211808 Feb 15 14:27:28.153057 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 237/465] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:27 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1743 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:28.808737 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-83891baa-a737-447c-a09e-82c0eeb5a6a6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:28.810050 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-83891baa-a737-447c-a09e-82c0eeb5a6a6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:28.826368 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-83891baa-a737-447c-a09e-82c0eeb5a6a6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:28.826814 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-83891baa-a737-447c-a09e-82c0eeb5a6a6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:28.827590 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-83891baa-a737-447c-a09e-82c0eeb5a6a6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:28.828019 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-83891baa-a737-447c-a09e-82c0eeb5a6a6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:29.004806 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-83891baa-a737-447c-a09e-82c0eeb5a6a6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:29.014829 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-83891baa-a737-447c-a09e-82c0eeb5a6a6 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.212434 Feb 15 14:27:29.015984 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 229/466] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:28 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:27:29.160789 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-2cf17460-ac75-4dc3-90ba-fd07e750e891 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:29.162124 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-2cf17460-ac75-4dc3-90ba-fd07e750e891 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:29.170574 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2cf17460-ac75-4dc3-90ba-fd07e750e891 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:29.171528 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2cf17460-ac75-4dc3-90ba-fd07e750e891 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:29.172620 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2cf17460-ac75-4dc3-90ba-fd07e750e891 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:29.173532 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2cf17460-ac75-4dc3-90ba-fd07e750e891 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:29.348295 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-2cf17460-ac75-4dc3-90ba-fd07e750e891 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:29.357690 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-2cf17460-ac75-4dc3-90ba-fd07e750e891 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:29.359228 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-2cf17460-ac75-4dc3-90ba-fd07e750e891 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:29.360625 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-2cf17460-ac75-4dc3-90ba-fd07e750e891 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1743 microversion: 2.20 time: 0.203947 Feb 15 14:27:29.361217 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 238/467] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:29 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1743 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:29.501612 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-f8a4c183-55b1-4e2f-aefc-0c7ffaed781e req-11f9c052-3437-4f7c-bc20-9e55443a10e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c04d927-9f34-4f11-8502-7175a64e3923", "name": "network-vif-plugged", "status": "completed", "tag": "23ef841c-69a3-483c-9bb9-680e3d5b6392"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:27:29.503457 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:27:29.503457 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:27:29.520998 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-f8a4c183-55b1-4e2f-aefc-0c7ffaed781e req-11f9c052-3437-4f7c-bc20-9e55443a10e7 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:29.521502 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-f8a4c183-55b1-4e2f-aefc-0c7ffaed781e req-11f9c052-3437-4f7c-bc20-9e55443a10e7 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:29.541867 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-f8a4c183-55b1-4e2f-aefc-0c7ffaed781e req-11f9c052-3437-4f7c-bc20-9e55443a10e7 service nova] Creating event network-vif-plugged:23ef841c-69a3-483c-9bb9-680e3d5b6392 for instance 9c04d927-9f34-4f11-8502-7175a64e3923 on hv-cinder-81914 Feb 15 14:27:29.548808 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-f8a4c183-55b1-4e2f-aefc-0c7ffaed781e req-11f9c052-3437-4f7c-bc20-9e55443a10e7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051090 Feb 15 14:27:29.550002 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 230/468] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:27:30.031721 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-e0226d2a-b1ec-402d-b687-b63d9a06a8e7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:30.035444 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-e0226d2a-b1ec-402d-b687-b63d9a06a8e7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:30.043050 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e0226d2a-b1ec-402d-b687-b63d9a06a8e7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:30.043825 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e0226d2a-b1ec-402d-b687-b63d9a06a8e7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:30.045553 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e0226d2a-b1ec-402d-b687-b63d9a06a8e7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:30.046146 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e0226d2a-b1ec-402d-b687-b63d9a06a8e7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:30.244470 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-e0226d2a-b1ec-402d-b687-b63d9a06a8e7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:30.253313 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-e0226d2a-b1ec-402d-b687-b63d9a06a8e7 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.225564 Feb 15 14:27:30.262077 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 239/469] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:30 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:30.379876 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-a8c733ae-fffa-4a43-8745-33de2bdae8fb tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:30.381170 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-a8c733ae-fffa-4a43-8745-33de2bdae8fb tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:30.391300 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a8c733ae-fffa-4a43-8745-33de2bdae8fb tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:30.393144 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a8c733ae-fffa-4a43-8745-33de2bdae8fb tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:30.394430 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a8c733ae-fffa-4a43-8745-33de2bdae8fb tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:30.394751 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a8c733ae-fffa-4a43-8745-33de2bdae8fb tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:30.607630 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-a8c733ae-fffa-4a43-8745-33de2bdae8fb tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:30.621762 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-a8c733ae-fffa-4a43-8745-33de2bdae8fb tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:30.628086 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-a8c733ae-fffa-4a43-8745-33de2bdae8fb tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:30.635447 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-a8c733ae-fffa-4a43-8745-33de2bdae8fb tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1738 microversion: 2.20 time: 0.259983 Feb 15 14:27:30.636348 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 231/470] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:30 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1738 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:31.281018 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-13e45727-744b-4ed2-bbbe-7ead4248f0ae tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:31.282366 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-13e45727-744b-4ed2-bbbe-7ead4248f0ae tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:31.302715 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-13e45727-744b-4ed2-bbbe-7ead4248f0ae tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:31.305510 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-13e45727-744b-4ed2-bbbe-7ead4248f0ae tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:31.307033 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-13e45727-744b-4ed2-bbbe-7ead4248f0ae tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:31.309232 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-13e45727-744b-4ed2-bbbe-7ead4248f0ae tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:31.581285 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-13e45727-744b-4ed2-bbbe-7ead4248f0ae tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:31.606991 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-13e45727-744b-4ed2-bbbe-7ead4248f0ae tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.329817 Feb 15 14:27:31.613761 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 240/471] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:31 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:31.658554 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-ec7fc69c-1da8-48c0-b2da-ae50ea28107c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:31.659993 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-ec7fc69c-1da8-48c0-b2da-ae50ea28107c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:31.687871 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ec7fc69c-1da8-48c0-b2da-ae50ea28107c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:31.696699 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ec7fc69c-1da8-48c0-b2da-ae50ea28107c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:31.697561 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ec7fc69c-1da8-48c0-b2da-ae50ea28107c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:31.698034 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ec7fc69c-1da8-48c0-b2da-ae50ea28107c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:31.956303 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-ec7fc69c-1da8-48c0-b2da-ae50ea28107c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:31.968103 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-ec7fc69c-1da8-48c0-b2da-ae50ea28107c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:31.970538 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-ec7fc69c-1da8-48c0-b2da-ae50ea28107c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:31.971935 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-ec7fc69c-1da8-48c0-b2da-ae50ea28107c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1738 microversion: 2.20 time: 0.318195 Feb 15 14:27:31.983288 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 232/472] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:31 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1738 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:32.630650 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-a0757bdd-7df6-47ed-9918-2722ec511e48 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:32.631268 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-a0757bdd-7df6-47ed-9918-2722ec511e48 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:32.645641 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a0757bdd-7df6-47ed-9918-2722ec511e48 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:32.648557 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a0757bdd-7df6-47ed-9918-2722ec511e48 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:32.649565 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a0757bdd-7df6-47ed-9918-2722ec511e48 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:32.653120 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a0757bdd-7df6-47ed-9918-2722ec511e48 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:32.896157 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a0757bdd-7df6-47ed-9918-2722ec511e48 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:32.905647 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-a0757bdd-7df6-47ed-9918-2722ec511e48 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.278710 Feb 15 14:27:32.907561 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 241/473] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:32 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:32.990464 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-eb666039-13ab-4b93-ae81-6c81d60df3f6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:32.991067 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-eb666039-13ab-4b93-ae81-6c81d60df3f6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:32.999787 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-eb666039-13ab-4b93-ae81-6c81d60df3f6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:33.000512 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-eb666039-13ab-4b93-ae81-6c81d60df3f6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:33.001481 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-eb666039-13ab-4b93-ae81-6c81d60df3f6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:33.002069 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-eb666039-13ab-4b93-ae81-6c81d60df3f6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:33.020859 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-05b3318f-58ed-4c3d-903e-1e07fe0617a1 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Action: 'create', calling method: .version_select at 0x7fd74f749700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-297716378"}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:27:33.037787 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-05b3318f-58ed-4c3d-903e-1e07fe0617a1 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Getting quotas for project 4b838dafad384c2a9df8223904cffd5c. Resources: {'key_pairs'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:27:33.043205 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-05b3318f-58ed-4c3d-903e-1e07fe0617a1 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Getting quotas for user 03cfb060fa954b5db63c9fe31bfad1ea and project 4b838dafad384c2a9df8223904cffd5c. Resources: {'key_pairs'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:27:33.058215 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: ERROR oslo.messaging._drivers.impl_rabbit [None req-05b3318f-58ed-4c3d-903e-1e07fe0617a1 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [1ed6c10c-e7dc-487c-9904-36d380d63193] AMQP server on 10.222.0.83:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 15 14:27:33.182724 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-eb666039-13ab-4b93-ae81-6c81d60df3f6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:33.191708 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-eb666039-13ab-4b93-ae81-6c81d60df3f6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:33.193870 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-eb666039-13ab-4b93-ae81-6c81d60df3f6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:33.196493 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-eb666039-13ab-4b93-ae81-6c81d60df3f6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1738 microversion: 2.20 time: 0.208613 Feb 15 14:27:33.197607 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 233/474] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:32 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:33.923927 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-7a96c05d-8b85-4730-a378-2a5831ebd6a8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:33.924587 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-7a96c05d-8b85-4730-a378-2a5831ebd6a8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:33.931755 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7a96c05d-8b85-4730-a378-2a5831ebd6a8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:33.932346 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7a96c05d-8b85-4730-a378-2a5831ebd6a8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:33.933202 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7a96c05d-8b85-4730-a378-2a5831ebd6a8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:33.933642 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7a96c05d-8b85-4730-a378-2a5831ebd6a8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:34.065375 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO oslo.messaging._drivers.impl_rabbit [None req-05b3318f-58ed-4c3d-903e-1e07fe0617a1 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [1ed6c10c-e7dc-487c-9904-36d380d63193] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 60726. Feb 15 14:27:34.117618 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-7a96c05d-8b85-4730-a378-2a5831ebd6a8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:34.130000 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-7a96c05d-8b85-4730-a378-2a5831ebd6a8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.209817 Feb 15 14:27:34.140877 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 234/475] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:33 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:27:34.217744 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-bd041c0b-0bd5-440c-9786-adc033e5f719 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:34.218351 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-bd041c0b-0bd5-440c-9786-adc033e5f719 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:34.224958 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bd041c0b-0bd5-440c-9786-adc033e5f719 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:34.225632 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bd041c0b-0bd5-440c-9786-adc033e5f719 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:34.226744 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bd041c0b-0bd5-440c-9786-adc033e5f719 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:34.227458 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bd041c0b-0bd5-440c-9786-adc033e5f719 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:34.243674 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-05b3318f-58ed-4c3d-903e-1e07fe0617a1 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Getting quotas for project 4b838dafad384c2a9df8223904cffd5c. Resources: {'key_pairs'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:27:34.248094 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-05b3318f-58ed-4c3d-903e-1e07fe0617a1 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Getting quotas for user 03cfb060fa954b5db63c9fe31bfad1ea and project 4b838dafad384c2a9df8223904cffd5c. Resources: {'key_pairs'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:27:34.263528 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-05b3318f-58ed-4c3d-903e-1e07fe0617a1 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 1.246710 Feb 15 14:27:34.264131 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 242/476] 10.222.0.83 () {60 vars in 1157 bytes} [Tue Feb 15 14:27:33 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:27:34.395597 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-bd041c0b-0bd5-440c-9786-adc033e5f719 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:34.405231 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-bd041c0b-0bd5-440c-9786-adc033e5f719 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:34.407035 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-bd041c0b-0bd5-440c-9786-adc033e5f719 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:34.408499 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-bd041c0b-0bd5-440c-9786-adc033e5f719 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1738 microversion: 2.20 time: 0.195529 Feb 15 14:27:34.409375 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 235/477] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:34 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:34.415803 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-36d10e82-529c-429c-ae95-324810a5400a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2077810944", "imageRef": "bea4789f-3d19-4ee5-bd81-149c43f27e40", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-297716378", "networks": [{"uuid": "91272c9a-55ee-4ecb-a201-9ea382ca4ad9"}]}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:27:34.483137 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.network.neutron [None req-36d10e82-529c-429c-ae95-324810a5400a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] validate_networks() for [('91272c9a-55ee-4ecb-a201-9ea382ca4ad9', None, None, None, None, None)] {{(pid=116363) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 14:27:34.963171 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-36d10e82-529c-429c-ae95-324810a5400a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Flavor limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 14:27:34.964223 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-36d10e82-529c-429c-ae95-324810a5400a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Image limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 14:27:34.964733 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-36d10e82-529c-429c-ae95-324810a5400a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Flavor pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 14:27:34.965145 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-36d10e82-529c-429c-ae95-324810a5400a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Image pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 14:27:34.965558 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-36d10e82-529c-429c-ae95-324810a5400a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 14:27:34.975362 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-36d10e82-529c-429c-ae95-324810a5400a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:34.975846 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-36d10e82-529c-429c-ae95-324810a5400a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:34.976878 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-36d10e82-529c-429c-ae95-324810a5400a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:34.977318 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-36d10e82-529c-429c-ae95-324810a5400a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:34.995463 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-36d10e82-529c-429c-ae95-324810a5400a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Getting quotas for project 4b838dafad384c2a9df8223904cffd5c. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:27:35.000103 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-36d10e82-529c-429c-ae95-324810a5400a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Getting quotas for user 03cfb060fa954b5db63c9fe31bfad1ea and project 4b838dafad384c2a9df8223904cffd5c. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:27:35.012423 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-36d10e82-529c-429c-ae95-324810a5400a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Going to run 1 instances... {{(pid=116363) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 14:27:35.014757 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-36d10e82-529c-429c-ae95-324810a5400a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bea4789f-3d19-4ee5-bd81-149c43f27e40',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 14:27:35.064137 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-36d10e82-529c-429c-ae95-324810a5400a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.652688 Feb 15 14:27:35.064846 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 243/478] 10.222.0.83 () {60 vars in 1146 bytes} [Tue Feb 15 14:27:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 14:27:35.074577 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-8d85a0c7-cf0f-4eae-874a-ab67e786b29a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:35.075432 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-8d85a0c7-cf0f-4eae-874a-ab67e786b29a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:35.147572 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-8d85a0c7-cf0f-4eae-874a-ab67e786b29a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:35.149419 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-488747cd-36e5-4132-bfe1-c0cd2e904d11 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:35.150040 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-488747cd-36e5-4132-bfe1-c0cd2e904d11 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:35.156459 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-8d85a0c7-cf0f-4eae-874a-ab67e786b29a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1258 microversion: 2.1 time: 0.085345 Feb 15 14:27:35.157314 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 236/479] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:35 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1258 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:35.174260 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-488747cd-36e5-4132-bfe1-c0cd2e904d11 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:35.174719 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-488747cd-36e5-4132-bfe1-c0cd2e904d11 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:35.175525 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-488747cd-36e5-4132-bfe1-c0cd2e904d11 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:35.175958 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-488747cd-36e5-4132-bfe1-c0cd2e904d11 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:35.344164 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-488747cd-36e5-4132-bfe1-c0cd2e904d11 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:35.353728 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-488747cd-36e5-4132-bfe1-c0cd2e904d11 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.209716 Feb 15 14:27:35.364064 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 244/480] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:35 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:27:35.432260 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-2554f6f0-1e42-4a48-af07-b458169d5f61 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:35.433062 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-2554f6f0-1e42-4a48-af07-b458169d5f61 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:35.443025 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2554f6f0-1e42-4a48-af07-b458169d5f61 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:35.443819 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2554f6f0-1e42-4a48-af07-b458169d5f61 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:35.445188 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2554f6f0-1e42-4a48-af07-b458169d5f61 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:35.445936 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2554f6f0-1e42-4a48-af07-b458169d5f61 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:35.889420 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-2554f6f0-1e42-4a48-af07-b458169d5f61 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:35.897692 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-2554f6f0-1e42-4a48-af07-b458169d5f61 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:35.900130 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-2554f6f0-1e42-4a48-af07-b458169d5f61 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:35.901704 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-2554f6f0-1e42-4a48-af07-b458169d5f61 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1738 microversion: 2.20 time: 0.475175 Feb 15 14:27:35.913272 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 237/481] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:35 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1738 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:36.174695 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-9dbe07dd-378a-4f82-9a3b-a293f69d6baa tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:36.175472 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-9dbe07dd-378a-4f82-9a3b-a293f69d6baa tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:36.194522 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9dbe07dd-378a-4f82-9a3b-a293f69d6baa tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:36.199166 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9dbe07dd-378a-4f82-9a3b-a293f69d6baa tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:36.200221 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9dbe07dd-378a-4f82-9a3b-a293f69d6baa tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:36.201630 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9dbe07dd-378a-4f82-9a3b-a293f69d6baa tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:36.331951 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-9dbe07dd-378a-4f82-9a3b-a293f69d6baa tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:36.357194 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-9dbe07dd-378a-4f82-9a3b-a293f69d6baa tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1310 microversion: 2.1 time: 0.186953 Feb 15 14:27:36.359000 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 245/482] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:36 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1310 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:27:36.376310 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-87779e90-fc96-4416-bf88-78564e1e4248 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:36.377216 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-87779e90-fc96-4416-bf88-78564e1e4248 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:36.387317 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-87779e90-fc96-4416-bf88-78564e1e4248 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:36.387894 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-87779e90-fc96-4416-bf88-78564e1e4248 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:36.388878 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-87779e90-fc96-4416-bf88-78564e1e4248 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:36.389524 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-87779e90-fc96-4416-bf88-78564e1e4248 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:36.686924 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-87779e90-fc96-4416-bf88-78564e1e4248 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:36.697481 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-87779e90-fc96-4416-bf88-78564e1e4248 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.325716 Feb 15 14:27:36.700447 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 238/483] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:36 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:36.923244 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-21f4c44e-f2ef-400d-a04c-08299d82823d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:36.924009 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-21f4c44e-f2ef-400d-a04c-08299d82823d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:36.931710 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-21f4c44e-f2ef-400d-a04c-08299d82823d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:36.932569 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-21f4c44e-f2ef-400d-a04c-08299d82823d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:36.933464 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-21f4c44e-f2ef-400d-a04c-08299d82823d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:36.933974 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-21f4c44e-f2ef-400d-a04c-08299d82823d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:37.165598 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-21f4c44e-f2ef-400d-a04c-08299d82823d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:37.176114 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-21f4c44e-f2ef-400d-a04c-08299d82823d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:37.178117 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-21f4c44e-f2ef-400d-a04c-08299d82823d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:37.179467 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-21f4c44e-f2ef-400d-a04c-08299d82823d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1738 microversion: 2.20 time: 0.259919 Feb 15 14:27:37.180448 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 246/484] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:36 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1738 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:37.375119 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-97c8681a-3183-4139-9329-1429c3a6db7c tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:37.375748 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-97c8681a-3183-4139-9329-1429c3a6db7c tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:37.398597 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-97c8681a-3183-4139-9329-1429c3a6db7c tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:37.399246 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-97c8681a-3183-4139-9329-1429c3a6db7c tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:37.399854 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-97c8681a-3183-4139-9329-1429c3a6db7c tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:37.400269 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-97c8681a-3183-4139-9329-1429c3a6db7c tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:37.717706 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-e47f0efe-d017-4076-934b-3b3240a3745c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:37.718847 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-e47f0efe-d017-4076-934b-3b3240a3745c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:37.737601 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e47f0efe-d017-4076-934b-3b3240a3745c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:37.739361 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e47f0efe-d017-4076-934b-3b3240a3745c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:37.742158 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e47f0efe-d017-4076-934b-3b3240a3745c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:37.743752 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e47f0efe-d017-4076-934b-3b3240a3745c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:37.865389 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-97c8681a-3183-4139-9329-1429c3a6db7c tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:37.889174 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-97c8681a-3183-4139-9329-1429c3a6db7c tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.517632 Feb 15 14:27:37.911666 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 239/485] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:37 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:37.977718 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-e47f0efe-d017-4076-934b-3b3240a3745c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:37.988558 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-e47f0efe-d017-4076-934b-3b3240a3745c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.276338 Feb 15 14:27:37.990109 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 247/486] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:37 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:38.198578 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-1194393d-9edb-4bdf-a489-c57730551f88 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:38.199241 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-1194393d-9edb-4bdf-a489-c57730551f88 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:38.218953 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1194393d-9edb-4bdf-a489-c57730551f88 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:38.219909 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1194393d-9edb-4bdf-a489-c57730551f88 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:38.220958 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1194393d-9edb-4bdf-a489-c57730551f88 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:38.221616 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1194393d-9edb-4bdf-a489-c57730551f88 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:38.554960 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-1194393d-9edb-4bdf-a489-c57730551f88 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:38.565822 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-1194393d-9edb-4bdf-a489-c57730551f88 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:38.571093 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-1194393d-9edb-4bdf-a489-c57730551f88 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:38.574813 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-1194393d-9edb-4bdf-a489-c57730551f88 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1738 microversion: 2.20 time: 0.380861 Feb 15 14:27:38.578565 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 240/487] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:38 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1738 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:38.831799 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-6d712b15-a1c5-407b-91ad-1645c4e4026f req-7b9ab57f-1767-46d7-a54e-c2e9fc855203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e14d18-ad60-48d1-8a93-b30daacb8ce7", "tag": "2628aace-ae5c-4b38-940c-d120d41232de"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:27:38.833570 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:27:38.833570 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:27:38.851993 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-6d712b15-a1c5-407b-91ad-1645c4e4026f req-7b9ab57f-1767-46d7-a54e-c2e9fc855203 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:38.857877 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-6d712b15-a1c5-407b-91ad-1645c4e4026f req-7b9ab57f-1767-46d7-a54e-c2e9fc855203 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:38.897309 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-6d712b15-a1c5-407b-91ad-1645c4e4026f req-7b9ab57f-1767-46d7-a54e-c2e9fc855203 service nova] Creating event network-changed:2628aace-ae5c-4b38-940c-d120d41232de for instance e5e14d18-ad60-48d1-8a93-b30daacb8ce7 on hv-cinder-81914 Feb 15 14:27:38.905709 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-6d712b15-a1c5-407b-91ad-1645c4e4026f req-7b9ab57f-1767-46d7-a54e-c2e9fc855203 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077636 Feb 15 14:27:38.907890 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 248/488] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:27:38.920759 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-2cef323c-3288-4bd5-8f49-9e77a9f2a670 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:38.921527 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-2cef323c-3288-4bd5-8f49-9e77a9f2a670 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:38.929877 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2cef323c-3288-4bd5-8f49-9e77a9f2a670 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:38.931762 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2cef323c-3288-4bd5-8f49-9e77a9f2a670 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:38.938205 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2cef323c-3288-4bd5-8f49-9e77a9f2a670 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:38.938947 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2cef323c-3288-4bd5-8f49-9e77a9f2a670 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:39.007618 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-e80482c3-e120-4b7f-865d-b12b13941549 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:39.009388 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-e80482c3-e120-4b7f-865d-b12b13941549 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:39.024423 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e80482c3-e120-4b7f-865d-b12b13941549 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:39.026482 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e80482c3-e120-4b7f-865d-b12b13941549 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:39.028307 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e80482c3-e120-4b7f-865d-b12b13941549 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:39.030778 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e80482c3-e120-4b7f-865d-b12b13941549 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:39.202635 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-2cef323c-3288-4bd5-8f49-9e77a9f2a670 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:39.222515 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-2cef323c-3288-4bd5-8f49-9e77a9f2a670 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.305178 Feb 15 14:27:39.233693 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 241/489] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:38 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:39.313695 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-e80482c3-e120-4b7f-865d-b12b13941549 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:39.322996 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-e80482c3-e120-4b7f-865d-b12b13941549 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.319447 Feb 15 14:27:39.332762 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 249/490] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:39 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:39.601946 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-61d969db-661c-4145-9daa-b750d7526b45 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:39.604045 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-61d969db-661c-4145-9daa-b750d7526b45 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:39.610463 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-61d969db-661c-4145-9daa-b750d7526b45 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:39.611232 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-61d969db-661c-4145-9daa-b750d7526b45 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:39.612247 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-61d969db-661c-4145-9daa-b750d7526b45 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:39.612923 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-61d969db-661c-4145-9daa-b750d7526b45 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:39.769267 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-61d969db-661c-4145-9daa-b750d7526b45 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:39.778168 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-61d969db-661c-4145-9daa-b750d7526b45 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:39.780588 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-61d969db-661c-4145-9daa-b750d7526b45 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:39.782018 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-61d969db-661c-4145-9daa-b750d7526b45 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1738 microversion: 2.20 time: 0.190564 Feb 15 14:27:39.785543 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 242/491] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:39 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:40.238899 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-923ae661-404f-4852-8491-c83a589bb466 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:40.239498 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-923ae661-404f-4852-8491-c83a589bb466 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:40.246253 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-923ae661-404f-4852-8491-c83a589bb466 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:40.247071 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-923ae661-404f-4852-8491-c83a589bb466 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:40.248097 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-923ae661-404f-4852-8491-c83a589bb466 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:40.248633 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-923ae661-404f-4852-8491-c83a589bb466 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:40.339689 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-9fe3d126-ae61-4b54-b1d7-cc0d4093b890 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:40.340329 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-9fe3d126-ae61-4b54-b1d7-cc0d4093b890 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:40.346683 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9fe3d126-ae61-4b54-b1d7-cc0d4093b890 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:40.347130 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9fe3d126-ae61-4b54-b1d7-cc0d4093b890 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:40.347905 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9fe3d126-ae61-4b54-b1d7-cc0d4093b890 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:40.348336 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9fe3d126-ae61-4b54-b1d7-cc0d4093b890 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:40.406253 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-923ae661-404f-4852-8491-c83a589bb466 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:40.414748 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-923ae661-404f-4852-8491-c83a589bb466 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.179405 Feb 15 14:27:40.415525 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 250/492] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:40 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:40.519330 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-9fe3d126-ae61-4b54-b1d7-cc0d4093b890 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:40.530877 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-9fe3d126-ae61-4b54-b1d7-cc0d4093b890 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.194867 Feb 15 14:27:40.532031 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 243/493] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:40 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:27:40.804981 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-b8295776-e6f2-4f7c-abf5-198c48482ad4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:40.805948 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-b8295776-e6f2-4f7c-abf5-198c48482ad4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:40.812084 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b8295776-e6f2-4f7c-abf5-198c48482ad4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:40.812639 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b8295776-e6f2-4f7c-abf5-198c48482ad4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:40.813827 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b8295776-e6f2-4f7c-abf5-198c48482ad4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:40.814456 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b8295776-e6f2-4f7c-abf5-198c48482ad4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:40.965527 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-b8295776-e6f2-4f7c-abf5-198c48482ad4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:40.974105 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-b8295776-e6f2-4f7c-abf5-198c48482ad4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:40.975736 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-b8295776-e6f2-4f7c-abf5-198c48482ad4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:40.977312 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-b8295776-e6f2-4f7c-abf5-198c48482ad4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1738 microversion: 2.20 time: 0.176577 Feb 15 14:27:40.977966 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 251/494] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:40 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:41.432527 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-482c621c-65b0-48cb-8e6d-1394b17382fe tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:41.433093 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-482c621c-65b0-48cb-8e6d-1394b17382fe tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:41.440365 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-482c621c-65b0-48cb-8e6d-1394b17382fe tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:41.440365 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-482c621c-65b0-48cb-8e6d-1394b17382fe tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:41.440697 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-482c621c-65b0-48cb-8e6d-1394b17382fe tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:41.441128 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-482c621c-65b0-48cb-8e6d-1394b17382fe tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:41.548973 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-808640e6-e94c-4211-89e2-30a638af4e28 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:41.550241 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-808640e6-e94c-4211-89e2-30a638af4e28 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:41.559051 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-808640e6-e94c-4211-89e2-30a638af4e28 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:41.559748 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-808640e6-e94c-4211-89e2-30a638af4e28 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:41.560820 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-808640e6-e94c-4211-89e2-30a638af4e28 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:41.561324 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-808640e6-e94c-4211-89e2-30a638af4e28 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:41.593340 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-482c621c-65b0-48cb-8e6d-1394b17382fe tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:41.602398 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-482c621c-65b0-48cb-8e6d-1394b17382fe tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.174006 Feb 15 14:27:41.603364 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 244/495] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:41 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:41.718031 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-808640e6-e94c-4211-89e2-30a638af4e28 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:41.726945 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-808640e6-e94c-4211-89e2-30a638af4e28 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.181550 Feb 15 14:27:41.727531 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 252/496] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:41 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:27:41.995426 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-94baa384-f6f4-4986-96c6-199cb6525900 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:41.996034 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-94baa384-f6f4-4986-96c6-199cb6525900 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:42.001969 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-94baa384-f6f4-4986-96c6-199cb6525900 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:42.002543 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-94baa384-f6f4-4986-96c6-199cb6525900 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:42.003358 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-94baa384-f6f4-4986-96c6-199cb6525900 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:42.003790 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-94baa384-f6f4-4986-96c6-199cb6525900 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:42.167400 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-94baa384-f6f4-4986-96c6-199cb6525900 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:42.176109 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-94baa384-f6f4-4986-96c6-199cb6525900 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:42.178260 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-94baa384-f6f4-4986-96c6-199cb6525900 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:42.180805 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-94baa384-f6f4-4986-96c6-199cb6525900 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1738 microversion: 2.20 time: 0.189643 Feb 15 14:27:42.192211 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 245/497] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:41 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:42.619945 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-12a8f2b8-2a27-49b7-b38c-2b4a7cbee81f tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:42.620613 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-12a8f2b8-2a27-49b7-b38c-2b4a7cbee81f tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:42.627822 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-12a8f2b8-2a27-49b7-b38c-2b4a7cbee81f tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:42.628357 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-12a8f2b8-2a27-49b7-b38c-2b4a7cbee81f tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:42.629178 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-12a8f2b8-2a27-49b7-b38c-2b4a7cbee81f tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:42.629598 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-12a8f2b8-2a27-49b7-b38c-2b4a7cbee81f tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:42.743272 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-f71ad14d-46ea-4ab6-a400-4933b24ecf6e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:42.743881 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-f71ad14d-46ea-4ab6-a400-4933b24ecf6e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:42.750211 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f71ad14d-46ea-4ab6-a400-4933b24ecf6e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:42.750660 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f71ad14d-46ea-4ab6-a400-4933b24ecf6e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:42.751440 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f71ad14d-46ea-4ab6-a400-4933b24ecf6e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:42.751878 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f71ad14d-46ea-4ab6-a400-4933b24ecf6e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:42.785148 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-12a8f2b8-2a27-49b7-b38c-2b4a7cbee81f tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:42.797647 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-12a8f2b8-2a27-49b7-b38c-2b4a7cbee81f tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.182163 Feb 15 14:27:42.798266 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 253/498] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:42 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:42.905233 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-f71ad14d-46ea-4ab6-a400-4933b24ecf6e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:42.914193 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-f71ad14d-46ea-4ab6-a400-4933b24ecf6e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.174120 Feb 15 14:27:42.914783 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 246/499] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:42 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:27:43.199198 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-8f00afd8-ef7c-4e0d-b8bd-71b6cf6d38a2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:43.200183 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-8f00afd8-ef7c-4e0d-b8bd-71b6cf6d38a2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:43.206740 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8f00afd8-ef7c-4e0d-b8bd-71b6cf6d38a2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:43.207289 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8f00afd8-ef7c-4e0d-b8bd-71b6cf6d38a2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:43.208207 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8f00afd8-ef7c-4e0d-b8bd-71b6cf6d38a2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:43.208693 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8f00afd8-ef7c-4e0d-b8bd-71b6cf6d38a2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:43.344770 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-8f00afd8-ef7c-4e0d-b8bd-71b6cf6d38a2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:43.354739 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-8f00afd8-ef7c-4e0d-b8bd-71b6cf6d38a2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:43.356388 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-8f00afd8-ef7c-4e0d-b8bd-71b6cf6d38a2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:43.357699 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-8f00afd8-ef7c-4e0d-b8bd-71b6cf6d38a2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1738 microversion: 2.20 time: 0.162333 Feb 15 14:27:43.358392 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 254/500] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:43 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:43.815110 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-e93434b1-21e0-4d8c-9391-2d56e9776619 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:43.815753 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-e93434b1-21e0-4d8c-9391-2d56e9776619 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:43.823019 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e93434b1-21e0-4d8c-9391-2d56e9776619 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:43.823468 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e93434b1-21e0-4d8c-9391-2d56e9776619 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:43.824253 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e93434b1-21e0-4d8c-9391-2d56e9776619 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:43.824700 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e93434b1-21e0-4d8c-9391-2d56e9776619 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:43.931022 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-c1a8407e-1e72-42db-afb0-6d48cd3398d9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:43.931787 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-c1a8407e-1e72-42db-afb0-6d48cd3398d9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:43.938007 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c1a8407e-1e72-42db-afb0-6d48cd3398d9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:43.940209 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c1a8407e-1e72-42db-afb0-6d48cd3398d9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:43.941241 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c1a8407e-1e72-42db-afb0-6d48cd3398d9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:43.941760 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c1a8407e-1e72-42db-afb0-6d48cd3398d9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:43.980916 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-e93434b1-21e0-4d8c-9391-2d56e9776619 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:43.990592 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-e93434b1-21e0-4d8c-9391-2d56e9776619 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.178935 Feb 15 14:27:44.001126 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 247/501] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:43 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:27:44.120316 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-c1a8407e-1e72-42db-afb0-6d48cd3398d9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:44.128988 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-c1a8407e-1e72-42db-afb0-6d48cd3398d9 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.201835 Feb 15 14:27:44.129568 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 255/502] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:43 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:27:44.381723 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-cd03b859-21c2-4d56-bcc3-6f0e5825512e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:44.383279 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-cd03b859-21c2-4d56-bcc3-6f0e5825512e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:44.389644 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cd03b859-21c2-4d56-bcc3-6f0e5825512e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:44.390095 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cd03b859-21c2-4d56-bcc3-6f0e5825512e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:44.390887 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cd03b859-21c2-4d56-bcc3-6f0e5825512e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:44.391487 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cd03b859-21c2-4d56-bcc3-6f0e5825512e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:44.532855 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-cd03b859-21c2-4d56-bcc3-6f0e5825512e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:44.541405 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-cd03b859-21c2-4d56-bcc3-6f0e5825512e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:44.543142 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-cd03b859-21c2-4d56-bcc3-6f0e5825512e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:44.544462 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-cd03b859-21c2-4d56-bcc3-6f0e5825512e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1738 microversion: 2.20 time: 0.167831 Feb 15 14:27:44.545176 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 248/503] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:44 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:45.009793 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-4d65d981-afd6-4393-9c9d-78d92f0021eb tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:45.010436 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-4d65d981-afd6-4393-9c9d-78d92f0021eb tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:45.017719 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4d65d981-afd6-4393-9c9d-78d92f0021eb tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:45.018103 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4d65d981-afd6-4393-9c9d-78d92f0021eb tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:45.018893 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4d65d981-afd6-4393-9c9d-78d92f0021eb tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:45.019331 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4d65d981-afd6-4393-9c9d-78d92f0021eb tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:45.148496 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-cd30a57a-bffa-4f63-9606-86a823be3286 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:45.150084 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-cd30a57a-bffa-4f63-9606-86a823be3286 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:45.157506 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cd30a57a-bffa-4f63-9606-86a823be3286 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:45.158293 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cd30a57a-bffa-4f63-9606-86a823be3286 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:45.159612 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cd30a57a-bffa-4f63-9606-86a823be3286 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:45.160194 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cd30a57a-bffa-4f63-9606-86a823be3286 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:45.228217 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-4d65d981-afd6-4393-9c9d-78d92f0021eb tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:45.236762 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-4d65d981-afd6-4393-9c9d-78d92f0021eb tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.232732 Feb 15 14:27:45.247217 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 256/504] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:45 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:45.329988 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-cd30a57a-bffa-4f63-9606-86a823be3286 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:45.341627 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-cd30a57a-bffa-4f63-9606-86a823be3286 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.198134 Feb 15 14:27:45.343034 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 249/505] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:45 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:27:45.566550 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-53a27716-e098-4269-b7e9-05e073b08bcc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:45.567933 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-53a27716-e098-4269-b7e9-05e073b08bcc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:45.575326 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-53a27716-e098-4269-b7e9-05e073b08bcc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:45.575997 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-53a27716-e098-4269-b7e9-05e073b08bcc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:45.576854 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-53a27716-e098-4269-b7e9-05e073b08bcc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:45.577296 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-53a27716-e098-4269-b7e9-05e073b08bcc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:45.759200 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-53a27716-e098-4269-b7e9-05e073b08bcc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:45.766926 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-53a27716-e098-4269-b7e9-05e073b08bcc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:45.768452 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-53a27716-e098-4269-b7e9-05e073b08bcc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:45.769603 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-53a27716-e098-4269-b7e9-05e073b08bcc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1738 microversion: 2.20 time: 0.209196 Feb 15 14:27:45.770607 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 257/506] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:45 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1738 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:46.254085 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-50179920-57c9-4681-b8e3-c78aab9719f0 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:46.255378 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-50179920-57c9-4681-b8e3-c78aab9719f0 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:46.262158 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-50179920-57c9-4681-b8e3-c78aab9719f0 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:46.262958 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-50179920-57c9-4681-b8e3-c78aab9719f0 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:46.263973 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-50179920-57c9-4681-b8e3-c78aab9719f0 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:46.264655 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-50179920-57c9-4681-b8e3-c78aab9719f0 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:46.359031 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-bd43f1dc-d6f9-42fa-99b4-f1751a9572b5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:46.359609 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-bd43f1dc-d6f9-42fa-99b4-f1751a9572b5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:46.371345 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bd43f1dc-d6f9-42fa-99b4-f1751a9572b5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:46.371795 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bd43f1dc-d6f9-42fa-99b4-f1751a9572b5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:46.372909 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bd43f1dc-d6f9-42fa-99b4-f1751a9572b5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:46.373549 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bd43f1dc-d6f9-42fa-99b4-f1751a9572b5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:46.460235 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-50179920-57c9-4681-b8e3-c78aab9719f0 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:46.469969 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-50179920-57c9-4681-b8e3-c78aab9719f0 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.219580 Feb 15 14:27:46.470862 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 250/507] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:46 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:46.577870 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-bd43f1dc-d6f9-42fa-99b4-f1751a9572b5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:46.586515 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-bd43f1dc-d6f9-42fa-99b4-f1751a9572b5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.231231 Feb 15 14:27:46.587105 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 258/508] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:46 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:27:46.787642 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-9883a91b-1463-4e22-b30b-646ea0a4ad62 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:46.788250 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-9883a91b-1463-4e22-b30b-646ea0a4ad62 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:46.794710 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9883a91b-1463-4e22-b30b-646ea0a4ad62 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:46.795159 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9883a91b-1463-4e22-b30b-646ea0a4ad62 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:46.795942 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9883a91b-1463-4e22-b30b-646ea0a4ad62 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:46.796422 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9883a91b-1463-4e22-b30b-646ea0a4ad62 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:46.961489 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-9883a91b-1463-4e22-b30b-646ea0a4ad62 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:46.976388 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-9883a91b-1463-4e22-b30b-646ea0a4ad62 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:46.977939 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-9883a91b-1463-4e22-b30b-646ea0a4ad62 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:46.982113 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-9883a91b-1463-4e22-b30b-646ea0a4ad62 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1738 microversion: 2.20 time: 0.198041 Feb 15 14:27:46.982588 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 251/509] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:46 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:47.487175 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-2f6ef054-9600-481c-8c76-65b2398a583b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:47.487883 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-2f6ef054-9600-481c-8c76-65b2398a583b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:47.498233 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2f6ef054-9600-481c-8c76-65b2398a583b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:47.499276 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2f6ef054-9600-481c-8c76-65b2398a583b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:47.500243 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2f6ef054-9600-481c-8c76-65b2398a583b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:47.500859 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2f6ef054-9600-481c-8c76-65b2398a583b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:47.611296 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-20d7262b-f611-474b-a95a-9f20156e8c7f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:47.612621 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-20d7262b-f611-474b-a95a-9f20156e8c7f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:47.620969 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-20d7262b-f611-474b-a95a-9f20156e8c7f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:47.621660 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-20d7262b-f611-474b-a95a-9f20156e8c7f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:47.622686 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-20d7262b-f611-474b-a95a-9f20156e8c7f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:47.623284 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-20d7262b-f611-474b-a95a-9f20156e8c7f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:47.700036 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-2f6ef054-9600-481c-8c76-65b2398a583b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:47.709444 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-2f6ef054-9600-481c-8c76-65b2398a583b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.225883 Feb 15 14:27:47.710826 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 259/510] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:47 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:47.804669 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-20d7262b-f611-474b-a95a-9f20156e8c7f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:47.815902 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-20d7262b-f611-474b-a95a-9f20156e8c7f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.215083 Feb 15 14:27:47.817108 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 252/511] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:47 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:27:48.002773 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-7d9c22bc-da28-49d0-a4d0-cdd37b2fb8c8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:48.003402 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-7d9c22bc-da28-49d0-a4d0-cdd37b2fb8c8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:48.009700 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7d9c22bc-da28-49d0-a4d0-cdd37b2fb8c8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:48.010226 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7d9c22bc-da28-49d0-a4d0-cdd37b2fb8c8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:48.011112 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7d9c22bc-da28-49d0-a4d0-cdd37b2fb8c8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:48.011620 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7d9c22bc-da28-49d0-a4d0-cdd37b2fb8c8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:48.164923 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-7d9c22bc-da28-49d0-a4d0-cdd37b2fb8c8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:48.175246 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-7d9c22bc-da28-49d0-a4d0-cdd37b2fb8c8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:48.177016 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-7d9c22bc-da28-49d0-a4d0-cdd37b2fb8c8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:48.178464 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-7d9c22bc-da28-49d0-a4d0-cdd37b2fb8c8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1738 microversion: 2.20 time: 0.179489 Feb 15 14:27:48.180200 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 260/512] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:47 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 14:27:48.727139 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-d270fef6-1d5f-4c60-a4ed-0d36b6486ace tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:48.727830 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-d270fef6-1d5f-4c60-a4ed-0d36b6486ace tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:48.734313 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d270fef6-1d5f-4c60-a4ed-0d36b6486ace tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:48.734774 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d270fef6-1d5f-4c60-a4ed-0d36b6486ace tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:48.735902 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d270fef6-1d5f-4c60-a4ed-0d36b6486ace tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:48.735983 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d270fef6-1d5f-4c60-a4ed-0d36b6486ace tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:48.833567 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-2e9bc61c-07b5-4986-963b-026bb9a51ccc tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:48.835037 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-2e9bc61c-07b5-4986-963b-026bb9a51ccc tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:48.841859 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2e9bc61c-07b5-4986-963b-026bb9a51ccc tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:48.842457 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2e9bc61c-07b5-4986-963b-026bb9a51ccc tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:48.843473 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2e9bc61c-07b5-4986-963b-026bb9a51ccc tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:48.843979 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2e9bc61c-07b5-4986-963b-026bb9a51ccc tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:48.881343 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-d270fef6-1d5f-4c60-a4ed-0d36b6486ace tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:48.889593 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-d270fef6-1d5f-4c60-a4ed-0d36b6486ace tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.166603 Feb 15 14:27:48.890177 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 253/513] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:48 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:49.000932 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-2e9bc61c-07b5-4986-963b-026bb9a51ccc tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:49.010452 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-2e9bc61c-07b5-4986-963b-026bb9a51ccc tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.180844 Feb 15 14:27:49.011047 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 261/514] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:48 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:49.198141 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-3dad6007-002b-45d9-8788-f3316d5b247f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:49.198940 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-3dad6007-002b-45d9-8788-f3316d5b247f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:49.204863 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3dad6007-002b-45d9-8788-f3316d5b247f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:49.205302 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3dad6007-002b-45d9-8788-f3316d5b247f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:49.206067 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3dad6007-002b-45d9-8788-f3316d5b247f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:49.206521 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3dad6007-002b-45d9-8788-f3316d5b247f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:49.344773 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-3dad6007-002b-45d9-8788-f3316d5b247f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:49.354029 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-3dad6007-002b-45d9-8788-f3316d5b247f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:49.355537 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-3dad6007-002b-45d9-8788-f3316d5b247f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:49.356758 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-3dad6007-002b-45d9-8788-f3316d5b247f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1738 microversion: 2.20 time: 0.162969 Feb 15 14:27:49.360602 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 254/515] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:49 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:49.907703 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-ed947c28-913a-4ef9-adf1-265c80a6eb4e tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:49.908339 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-ed947c28-913a-4ef9-adf1-265c80a6eb4e tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:49.915566 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ed947c28-913a-4ef9-adf1-265c80a6eb4e tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:49.916015 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ed947c28-913a-4ef9-adf1-265c80a6eb4e tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:49.916882 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ed947c28-913a-4ef9-adf1-265c80a6eb4e tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:49.917313 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ed947c28-913a-4ef9-adf1-265c80a6eb4e tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:50.028245 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-2e285cf6-a0f6-478d-96ba-19fb28894f7d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:50.028885 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-2e285cf6-a0f6-478d-96ba-19fb28894f7d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:50.037418 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2e285cf6-a0f6-478d-96ba-19fb28894f7d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:50.038575 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2e285cf6-a0f6-478d-96ba-19fb28894f7d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:50.039429 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2e285cf6-a0f6-478d-96ba-19fb28894f7d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:50.039885 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2e285cf6-a0f6-478d-96ba-19fb28894f7d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:50.054664 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-ed947c28-913a-4ef9-adf1-265c80a6eb4e tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:50.062259 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-ed947c28-913a-4ef9-adf1-265c80a6eb4e tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.158880 Feb 15 14:27:50.062877 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 262/516] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:49 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:50.249732 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-2e285cf6-a0f6-478d-96ba-19fb28894f7d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:50.257572 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-2e285cf6-a0f6-478d-96ba-19fb28894f7d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.232992 Feb 15 14:27:50.258142 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 255/517] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:50 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:50.374962 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-24eef8fd-a5ca-4478-a404-810cdca12e6a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:50.375697 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-24eef8fd-a5ca-4478-a404-810cdca12e6a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:50.381642 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-24eef8fd-a5ca-4478-a404-810cdca12e6a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:50.381962 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-24eef8fd-a5ca-4478-a404-810cdca12e6a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:50.382827 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-24eef8fd-a5ca-4478-a404-810cdca12e6a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:50.383265 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-24eef8fd-a5ca-4478-a404-810cdca12e6a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:50.772588 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-24eef8fd-a5ca-4478-a404-810cdca12e6a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:50.780817 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-24eef8fd-a5ca-4478-a404-810cdca12e6a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:50.782737 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-24eef8fd-a5ca-4478-a404-810cdca12e6a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:50.784185 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-24eef8fd-a5ca-4478-a404-810cdca12e6a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1738 microversion: 2.20 time: 0.412985 Feb 15 14:27:50.784852 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 263/518] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:50 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1738 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:51.080581 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-0bea56aa-6f16-41c0-8904-6d1d452831b0 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:51.081199 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-0bea56aa-6f16-41c0-8904-6d1d452831b0 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:51.089679 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0bea56aa-6f16-41c0-8904-6d1d452831b0 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:51.090122 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0bea56aa-6f16-41c0-8904-6d1d452831b0 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:51.090899 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0bea56aa-6f16-41c0-8904-6d1d452831b0 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:51.091938 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0bea56aa-6f16-41c0-8904-6d1d452831b0 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:51.239158 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-0bea56aa-6f16-41c0-8904-6d1d452831b0 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:51.247507 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-0bea56aa-6f16-41c0-8904-6d1d452831b0 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.170642 Feb 15 14:27:51.248258 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 256/519] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:51 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:51.274644 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-2b5572cf-eee5-481a-8f84-fa591756268c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:51.275253 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-2b5572cf-eee5-481a-8f84-fa591756268c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:51.281499 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2b5572cf-eee5-481a-8f84-fa591756268c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:51.282444 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2b5572cf-eee5-481a-8f84-fa591756268c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:51.283254 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2b5572cf-eee5-481a-8f84-fa591756268c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:51.283693 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2b5572cf-eee5-481a-8f84-fa591756268c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:51.417860 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-2b5572cf-eee5-481a-8f84-fa591756268c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:51.425748 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-2b5572cf-eee5-481a-8f84-fa591756268c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.155151 Feb 15 14:27:51.426320 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 264/520] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:51 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:51.803093 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-9ab0e4e5-74ca-49cc-bc41-5aa355a53730 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:51.803699 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-9ab0e4e5-74ca-49cc-bc41-5aa355a53730 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:51.809640 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9ab0e4e5-74ca-49cc-bc41-5aa355a53730 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:51.810093 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9ab0e4e5-74ca-49cc-bc41-5aa355a53730 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:51.810865 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9ab0e4e5-74ca-49cc-bc41-5aa355a53730 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:51.811299 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9ab0e4e5-74ca-49cc-bc41-5aa355a53730 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:51.944056 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-9ab0e4e5-74ca-49cc-bc41-5aa355a53730 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:51.952498 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-9ab0e4e5-74ca-49cc-bc41-5aa355a53730 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:51.954006 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-9ab0e4e5-74ca-49cc-bc41-5aa355a53730 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:51.955143 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-9ab0e4e5-74ca-49cc-bc41-5aa355a53730 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1720 microversion: 2.20 time: 0.155807 Feb 15 14:27:51.955704 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 257/521] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:51 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:52.263365 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-45acff90-c4fb-4356-8750-6ee35725e0ed tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:52.263970 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-45acff90-c4fb-4356-8750-6ee35725e0ed tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:52.269886 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-45acff90-c4fb-4356-8750-6ee35725e0ed tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:52.270330 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-45acff90-c4fb-4356-8750-6ee35725e0ed tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:52.271091 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-45acff90-c4fb-4356-8750-6ee35725e0ed tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:52.271518 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-45acff90-c4fb-4356-8750-6ee35725e0ed tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:52.404553 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-45acff90-c4fb-4356-8750-6ee35725e0ed tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:52.412005 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-45acff90-c4fb-4356-8750-6ee35725e0ed tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.152269 Feb 15 14:27:52.412607 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 265/522] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:52 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:52.442314 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-5420410b-2949-4a59-a646-0b904d291822 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:52.442926 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-5420410b-2949-4a59-a646-0b904d291822 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:52.449245 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5420410b-2949-4a59-a646-0b904d291822 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:52.449691 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5420410b-2949-4a59-a646-0b904d291822 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:52.450467 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5420410b-2949-4a59-a646-0b904d291822 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:52.450905 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5420410b-2949-4a59-a646-0b904d291822 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:52.583873 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-5420410b-2949-4a59-a646-0b904d291822 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:52.591692 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-5420410b-2949-4a59-a646-0b904d291822 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.152956 Feb 15 14:27:52.592262 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 258/523] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:52 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:52.974394 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-970b60d1-890f-42ca-8980-c58911b29f8a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:52.974995 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-970b60d1-890f-42ca-8980-c58911b29f8a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:52.981530 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-970b60d1-890f-42ca-8980-c58911b29f8a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:52.981973 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-970b60d1-890f-42ca-8980-c58911b29f8a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:52.982732 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-970b60d1-890f-42ca-8980-c58911b29f8a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:52.983160 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-970b60d1-890f-42ca-8980-c58911b29f8a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:53.118519 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-970b60d1-890f-42ca-8980-c58911b29f8a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:53.126507 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-970b60d1-890f-42ca-8980-c58911b29f8a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:53.128009 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-970b60d1-890f-42ca-8980-c58911b29f8a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:53.129180 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-970b60d1-890f-42ca-8980-c58911b29f8a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1720 microversion: 2.20 time: 0.158493 Feb 15 14:27:53.129740 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 266/524] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:52 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:53.429690 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-07293141-d975-4dc5-a229-01d324a7d96b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:53.430293 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-07293141-d975-4dc5-a229-01d324a7d96b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:53.436227 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-07293141-d975-4dc5-a229-01d324a7d96b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:53.436710 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-07293141-d975-4dc5-a229-01d324a7d96b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:53.437529 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-07293141-d975-4dc5-a229-01d324a7d96b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:53.437970 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-07293141-d975-4dc5-a229-01d324a7d96b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:53.567164 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-07293141-d975-4dc5-a229-01d324a7d96b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:53.574868 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-07293141-d975-4dc5-a229-01d324a7d96b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.149360 Feb 15 14:27:53.575437 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 259/525] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:53 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:53.608837 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-99e3c9d4-be43-4174-ac39-56220ad8838e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:53.609450 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-99e3c9d4-be43-4174-ac39-56220ad8838e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:53.615616 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-99e3c9d4-be43-4174-ac39-56220ad8838e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:53.616853 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-99e3c9d4-be43-4174-ac39-56220ad8838e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:53.617627 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-99e3c9d4-be43-4174-ac39-56220ad8838e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:53.618066 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-99e3c9d4-be43-4174-ac39-56220ad8838e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:53.747161 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-99e3c9d4-be43-4174-ac39-56220ad8838e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:53.754861 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-99e3c9d4-be43-4174-ac39-56220ad8838e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.149605 Feb 15 14:27:53.755424 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 267/526] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:53 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:54.146822 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-5edad491-3c38-4bd7-ab4b-5339b1b4f262 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:54.148038 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-5edad491-3c38-4bd7-ab4b-5339b1b4f262 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:54.154035 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5edad491-3c38-4bd7-ab4b-5339b1b4f262 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:54.154489 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5edad491-3c38-4bd7-ab4b-5339b1b4f262 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:54.155261 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5edad491-3c38-4bd7-ab4b-5339b1b4f262 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:54.155698 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5edad491-3c38-4bd7-ab4b-5339b1b4f262 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:54.270112 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-818b8e5b-bb06-4f7d-966a-4763841be732 req-1f954c73-1afd-4a3c-8a63-572d4931ce83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c04d927-9f34-4f11-8502-7175a64e3923", "name": "network-vif-unplugged", "status": "completed", "tag": "23ef841c-69a3-483c-9bb9-680e3d5b6392"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:27:54.271827 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:27:54.271827 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:27:54.280213 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-818b8e5b-bb06-4f7d-966a-4763841be732 req-1f954c73-1afd-4a3c-8a63-572d4931ce83 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:54.280681 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-818b8e5b-bb06-4f7d-966a-4763841be732 req-1f954c73-1afd-4a3c-8a63-572d4931ce83 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:54.291108 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-5edad491-3c38-4bd7-ab4b-5339b1b4f262 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:54.294062 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-818b8e5b-bb06-4f7d-966a-4763841be732 req-1f954c73-1afd-4a3c-8a63-572d4931ce83 service nova] Creating event network-vif-unplugged:23ef841c-69a3-483c-9bb9-680e3d5b6392 for instance 9c04d927-9f34-4f11-8502-7175a64e3923 on hv-cinder-81914 Feb 15 14:27:54.299380 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-818b8e5b-bb06-4f7d-966a-4763841be732 req-1f954c73-1afd-4a3c-8a63-572d4931ce83 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033026 Feb 15 14:27:54.300371 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 268/527] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:27:54.301061 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-5edad491-3c38-4bd7-ab4b-5339b1b4f262 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:54.302898 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-5edad491-3c38-4bd7-ab4b-5339b1b4f262 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:54.304390 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-5edad491-3c38-4bd7-ab4b-5339b1b4f262 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1720 microversion: 2.20 time: 0.161281 Feb 15 14:27:54.305425 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 260/528] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:54 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:54.591898 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-d12bc15e-5beb-43b2-9019-074c16d43c99 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:54.592636 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-d12bc15e-5beb-43b2-9019-074c16d43c99 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:54.598610 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d12bc15e-5beb-43b2-9019-074c16d43c99 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:54.599059 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d12bc15e-5beb-43b2-9019-074c16d43c99 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:54.599857 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d12bc15e-5beb-43b2-9019-074c16d43c99 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:54.600384 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d12bc15e-5beb-43b2-9019-074c16d43c99 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:54.737869 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-d12bc15e-5beb-43b2-9019-074c16d43c99 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:54.745871 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-d12bc15e-5beb-43b2-9019-074c16d43c99 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.157999 Feb 15 14:27:54.746435 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 269/529] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:54 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:54.772907 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-8adeac2e-e695-498d-9c70-0f1abe060ab0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:54.773610 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-8adeac2e-e695-498d-9c70-0f1abe060ab0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:54.779426 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8adeac2e-e695-498d-9c70-0f1abe060ab0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:54.779869 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8adeac2e-e695-498d-9c70-0f1abe060ab0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:54.780671 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8adeac2e-e695-498d-9c70-0f1abe060ab0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:54.781112 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8adeac2e-e695-498d-9c70-0f1abe060ab0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:54.916327 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-8adeac2e-e695-498d-9c70-0f1abe060ab0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:54.924972 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-8adeac2e-e695-498d-9c70-0f1abe060ab0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.156525 Feb 15 14:27:54.925558 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 261/530] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:54 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:55.322219 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-bc9a9a1b-c3b1-4346-a9f2-e5b82ff2bce9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:55.322854 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-bc9a9a1b-c3b1-4346-a9f2-e5b82ff2bce9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:55.329657 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bc9a9a1b-c3b1-4346-a9f2-e5b82ff2bce9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:55.330107 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bc9a9a1b-c3b1-4346-a9f2-e5b82ff2bce9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:55.330882 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bc9a9a1b-c3b1-4346-a9f2-e5b82ff2bce9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:55.331405 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bc9a9a1b-c3b1-4346-a9f2-e5b82ff2bce9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:55.461567 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-bc9a9a1b-c3b1-4346-a9f2-e5b82ff2bce9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:55.469458 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-bc9a9a1b-c3b1-4346-a9f2-e5b82ff2bce9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:55.470936 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-bc9a9a1b-c3b1-4346-a9f2-e5b82ff2bce9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:55.472066 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-bc9a9a1b-c3b1-4346-a9f2-e5b82ff2bce9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1663 microversion: 2.20 time: 0.153740 Feb 15 14:27:55.472661 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 270/531] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:55 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:55.489587 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-92475939-376f-487b-888b-b36f67800ae7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6669416-8409-4fc2-8437-523260877c16"}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:27:55.491402 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-92475939-376f-487b-888b-b36f67800ae7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:55.497637 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-92475939-376f-487b-888b-b36f67800ae7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:55.498092 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-92475939-376f-487b-888b-b36f67800ae7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:55.498896 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-92475939-376f-487b-888b-b36f67800ae7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:55.499363 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-92475939-376f-487b-888b-b36f67800ae7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:55.762176 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-a7d85e65-63b3-4c1b-b71c-55db4d800e10 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:55.766069 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-a7d85e65-63b3-4c1b-b71c-55db4d800e10 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:55.771655 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a7d85e65-63b3-4c1b-b71c-55db4d800e10 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:55.772160 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a7d85e65-63b3-4c1b-b71c-55db4d800e10 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:55.772998 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a7d85e65-63b3-4c1b-b71c-55db4d800e10 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:55.773633 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a7d85e65-63b3-4c1b-b71c-55db4d800e10 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:55.783124 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-92475939-376f-487b-888b-b36f67800ae7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "POST /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.297065 Feb 15 14:27:55.784472 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 262/532] 10.222.0.83 () {62 vars in 1363 bytes} [Tue Feb 15 14:27:55 2022] POST /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923/os-volume_attachments => generated 188 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 15 14:27:55.905407 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-e30571af-e8fc-4762-a337-632e931cd9d4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:27:55.905976 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-e30571af-e8fc-4762-a337-632e931cd9d4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:55.912999 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e30571af-e8fc-4762-a337-632e931cd9d4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:55.913452 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e30571af-e8fc-4762-a337-632e931cd9d4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:55.914235 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e30571af-e8fc-4762-a337-632e931cd9d4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:55.914760 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e30571af-e8fc-4762-a337-632e931cd9d4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:55.929321 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a7d85e65-63b3-4c1b-b71c-55db4d800e10 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:55.936886 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-a7d85e65-63b3-4c1b-b71c-55db4d800e10 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.178183 Feb 15 14:27:55.939378 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 271/533] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:55 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:27:55.945085 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-f9ab92df-6513-4ed9-a453-8c301f9e8990 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:55.945790 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-f9ab92df-6513-4ed9-a453-8c301f9e8990 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:55.951841 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f9ab92df-6513-4ed9-a453-8c301f9e8990 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:55.952284 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f9ab92df-6513-4ed9-a453-8c301f9e8990 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:55.953114 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f9ab92df-6513-4ed9-a453-8c301f9e8990 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:55.953541 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f9ab92df-6513-4ed9-a453-8c301f9e8990 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:56.041800 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-e30571af-e8fc-4762-a337-632e931cd9d4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "POST /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923/action" status: 202 len: 0 microversion: 2.20 time: 0.139973 Feb 15 14:27:56.043170 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 263/534] 10.222.0.83 () {62 vars in 1318 bytes} [Tue Feb 15 14:27:55 2022] POST /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 15 14:27:56.061411 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-98f05f96-93bc-427c-8e5d-74c6a15c6bf0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:56.062116 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-98f05f96-93bc-427c-8e5d-74c6a15c6bf0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:56.070004 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-98f05f96-93bc-427c-8e5d-74c6a15c6bf0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:56.070710 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-98f05f96-93bc-427c-8e5d-74c6a15c6bf0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:56.071792 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-98f05f96-93bc-427c-8e5d-74c6a15c6bf0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:56.072536 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-98f05f96-93bc-427c-8e5d-74c6a15c6bf0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:56.121359 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-f9ab92df-6513-4ed9-a453-8c301f9e8990 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:56.131958 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-f9ab92df-6513-4ed9-a453-8c301f9e8990 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.190852 Feb 15 14:27:56.132776 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 272/535] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:55 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:56.232506 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-98f05f96-93bc-427c-8e5d-74c6a15c6bf0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:56.241859 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-98f05f96-93bc-427c-8e5d-74c6a15c6bf0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:56.243393 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-98f05f96-93bc-427c-8e5d-74c6a15c6bf0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:56.244597 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-98f05f96-93bc-427c-8e5d-74c6a15c6bf0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1749 microversion: 2.20 time: 0.196257 Feb 15 14:27:56.245160 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 264/536] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:56 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1749 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:56.955258 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-e1c01715-400b-44dc-a32c-3c6153e41a3d tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:56.956924 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-e1c01715-400b-44dc-a32c-3c6153e41a3d tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:56.965716 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e1c01715-400b-44dc-a32c-3c6153e41a3d tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:56.966455 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e1c01715-400b-44dc-a32c-3c6153e41a3d tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:56.967311 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e1c01715-400b-44dc-a32c-3c6153e41a3d tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:56.967836 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e1c01715-400b-44dc-a32c-3c6153e41a3d tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:57.114388 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-e1c01715-400b-44dc-a32c-3c6153e41a3d tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:57.129167 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-e1c01715-400b-44dc-a32c-3c6153e41a3d tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.177677 Feb 15 14:27:57.130105 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 273/537] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:56 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:57.152393 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-b9ecaacb-e1a6-4d5b-b61a-16c3cb5efc17 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:57.153115 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-b9ecaacb-e1a6-4d5b-b61a-16c3cb5efc17 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:57.160741 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b9ecaacb-e1a6-4d5b-b61a-16c3cb5efc17 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:57.161874 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b9ecaacb-e1a6-4d5b-b61a-16c3cb5efc17 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:57.163188 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b9ecaacb-e1a6-4d5b-b61a-16c3cb5efc17 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:57.163722 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b9ecaacb-e1a6-4d5b-b61a-16c3cb5efc17 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:57.263169 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-ef4f48fa-a918-4f12-aa05-5b767965bcc7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:57.263775 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-ef4f48fa-a918-4f12-aa05-5b767965bcc7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:57.272099 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ef4f48fa-a918-4f12-aa05-5b767965bcc7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:57.272590 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ef4f48fa-a918-4f12-aa05-5b767965bcc7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:57.273369 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ef4f48fa-a918-4f12-aa05-5b767965bcc7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:57.273795 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ef4f48fa-a918-4f12-aa05-5b767965bcc7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:57.321492 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-b9ecaacb-e1a6-4d5b-b61a-16c3cb5efc17 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:57.329332 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-b9ecaacb-e1a6-4d5b-b61a-16c3cb5efc17 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.183945 Feb 15 14:27:57.330128 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 265/538] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:57 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:27:57.422620 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-ef4f48fa-a918-4f12-aa05-5b767965bcc7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:57.431621 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-ef4f48fa-a918-4f12-aa05-5b767965bcc7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:57.433178 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-ef4f48fa-a918-4f12-aa05-5b767965bcc7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:57.434387 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-ef4f48fa-a918-4f12-aa05-5b767965bcc7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1751 microversion: 2.20 time: 0.174800 Feb 15 14:27:57.434935 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 274/539] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:57 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 14:27:58.145440 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-7df979df-a999-43d8-bda3-701e23f4ea21 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:58.145976 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-7df979df-a999-43d8-bda3-701e23f4ea21 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:58.152068 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7df979df-a999-43d8-bda3-701e23f4ea21 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:58.153112 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7df979df-a999-43d8-bda3-701e23f4ea21 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:58.153893 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7df979df-a999-43d8-bda3-701e23f4ea21 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:58.154324 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7df979df-a999-43d8-bda3-701e23f4ea21 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:58.306373 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-7df979df-a999-43d8-bda3-701e23f4ea21 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:58.318512 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-7df979df-a999-43d8-bda3-701e23f4ea21 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.176127 Feb 15 14:27:58.319637 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 266/540] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:58 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:58.347371 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-9cfb3b0e-fac3-4820-9e42-2fa848309c9d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:58.347990 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-9cfb3b0e-fac3-4820-9e42-2fa848309c9d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:58.354652 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9cfb3b0e-fac3-4820-9e42-2fa848309c9d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:58.355370 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9cfb3b0e-fac3-4820-9e42-2fa848309c9d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:58.356331 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9cfb3b0e-fac3-4820-9e42-2fa848309c9d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:58.356802 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9cfb3b0e-fac3-4820-9e42-2fa848309c9d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:58.375519 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-5c4d24ae-ddbd-45d4-8998-cc69d687abd9 req-ca219449-8c76-4176-ab09-1bf280d8afef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e14d18-ad60-48d1-8a93-b30daacb8ce7", "name": "network-vif-plugged", "status": "completed", "tag": "2628aace-ae5c-4b38-940c-d120d41232de"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:27:58.378181 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:27:58.378181 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:27:58.387758 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-5c4d24ae-ddbd-45d4-8998-cc69d687abd9 req-ca219449-8c76-4176-ab09-1bf280d8afef service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:58.388547 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-5c4d24ae-ddbd-45d4-8998-cc69d687abd9 req-ca219449-8c76-4176-ab09-1bf280d8afef service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:58.405012 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-5c4d24ae-ddbd-45d4-8998-cc69d687abd9 req-ca219449-8c76-4176-ab09-1bf280d8afef service nova] Creating event network-vif-plugged:2628aace-ae5c-4b38-940c-d120d41232de for instance e5e14d18-ad60-48d1-8a93-b30daacb8ce7 on hv-cinder-81914 Feb 15 14:27:58.411255 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-5c4d24ae-ddbd-45d4-8998-cc69d687abd9 req-ca219449-8c76-4176-ab09-1bf280d8afef service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039628 Feb 15 14:27:58.412703 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 267/541] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:27:58.455299 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-5c49176f-142f-47ee-9687-a9f8ae564336 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:58.455988 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-5c49176f-142f-47ee-9687-a9f8ae564336 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:58.464063 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5c49176f-142f-47ee-9687-a9f8ae564336 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:58.464806 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5c49176f-142f-47ee-9687-a9f8ae564336 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:58.465755 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5c49176f-142f-47ee-9687-a9f8ae564336 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:58.466405 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5c49176f-142f-47ee-9687-a9f8ae564336 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:58.635436 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-9cfb3b0e-fac3-4820-9e42-2fa848309c9d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:58.644169 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-9cfb3b0e-fac3-4820-9e42-2fa848309c9d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.300924 Feb 15 14:27:58.655045 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 275/542] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:58 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:58.681465 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-5c49176f-142f-47ee-9687-a9f8ae564336 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:58.690940 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-5c49176f-142f-47ee-9687-a9f8ae564336 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:58.692530 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-5c49176f-142f-47ee-9687-a9f8ae564336 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:58.693923 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-5c49176f-142f-47ee-9687-a9f8ae564336 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1807 microversion: 2.20 time: 0.243171 Feb 15 14:27:58.694560 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 268/543] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:58 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1807 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:27:59.335353 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-cf6b7f41-da80-45d1-aa3b-30f107010366 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:59.336010 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-cf6b7f41-da80-45d1-aa3b-30f107010366 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:59.342469 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-cf6b7f41-da80-45d1-aa3b-30f107010366 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:59.342923 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-cf6b7f41-da80-45d1-aa3b-30f107010366 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:59.343888 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-cf6b7f41-da80-45d1-aa3b-30f107010366 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:59.344325 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-cf6b7f41-da80-45d1-aa3b-30f107010366 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:59.501230 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-cf6b7f41-da80-45d1-aa3b-30f107010366 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:59.511840 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-cf6b7f41-da80-45d1-aa3b-30f107010366 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.180216 Feb 15 14:27:59.513020 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 276/544] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:59 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:27:59.666857 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-f818d993-a9df-4c30-8447-55524194fa2b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:59.668334 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-f818d993-a9df-4c30-8447-55524194fa2b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:59.681147 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f818d993-a9df-4c30-8447-55524194fa2b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:59.683165 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f818d993-a9df-4c30-8447-55524194fa2b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:59.685227 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f818d993-a9df-4c30-8447-55524194fa2b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:59.689085 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f818d993-a9df-4c30-8447-55524194fa2b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:59.719543 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-76b42ee3-ce47-4d1b-86e8-62b824a5dde2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:27:59.721963 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-76b42ee3-ce47-4d1b-86e8-62b824a5dde2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:27:59.738694 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-76b42ee3-ce47-4d1b-86e8-62b824a5dde2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:59.740301 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-76b42ee3-ce47-4d1b-86e8-62b824a5dde2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:59.744703 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-76b42ee3-ce47-4d1b-86e8-62b824a5dde2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:27:59.745984 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-76b42ee3-ce47-4d1b-86e8-62b824a5dde2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:27:59.956075 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-f818d993-a9df-4c30-8447-55524194fa2b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:27:59.972351 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-f818d993-a9df-4c30-8447-55524194fa2b tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.313413 Feb 15 14:27:59.983253 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 269/545] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:27:59 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:00.076713 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-76b42ee3-ce47-4d1b-86e8-62b824a5dde2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:00.098305 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-76b42ee3-ce47-4d1b-86e8-62b824a5dde2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:00.099848 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-76b42ee3-ce47-4d1b-86e8-62b824a5dde2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:00.101262 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-76b42ee3-ce47-4d1b-86e8-62b824a5dde2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1807 microversion: 2.20 time: 0.392095 Feb 15 14:28:00.106210 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 277/546] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:27:59 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1807 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:28:00.529076 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-a57dc5d3-a29c-4184-aafb-0d48b039309a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:00.530069 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-a57dc5d3-a29c-4184-aafb-0d48b039309a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:00.537908 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a57dc5d3-a29c-4184-aafb-0d48b039309a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:00.538587 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a57dc5d3-a29c-4184-aafb-0d48b039309a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:00.539726 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a57dc5d3-a29c-4184-aafb-0d48b039309a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:00.540315 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a57dc5d3-a29c-4184-aafb-0d48b039309a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:00.739234 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-a57dc5d3-a29c-4184-aafb-0d48b039309a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:00.746923 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-a57dc5d3-a29c-4184-aafb-0d48b039309a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.221757 Feb 15 14:28:00.747512 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 270/547] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:00 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:00.990598 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-64c2a999-bbe2-4af4-9a57-9ee76a91c71e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:00.991377 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-64c2a999-bbe2-4af4-9a57-9ee76a91c71e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:00.999450 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-64c2a999-bbe2-4af4-9a57-9ee76a91c71e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:01.000216 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-64c2a999-bbe2-4af4-9a57-9ee76a91c71e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:01.001143 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-64c2a999-bbe2-4af4-9a57-9ee76a91c71e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:01.001771 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-64c2a999-bbe2-4af4-9a57-9ee76a91c71e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:01.119933 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-c327be1c-ad88-4636-8c5f-2707ef0670d3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:01.121167 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-c327be1c-ad88-4636-8c5f-2707ef0670d3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:01.137539 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c327be1c-ad88-4636-8c5f-2707ef0670d3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:01.138419 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c327be1c-ad88-4636-8c5f-2707ef0670d3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:01.140074 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c327be1c-ad88-4636-8c5f-2707ef0670d3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:01.140630 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c327be1c-ad88-4636-8c5f-2707ef0670d3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:01.179704 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-64c2a999-bbe2-4af4-9a57-9ee76a91c71e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:01.188733 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-64c2a999-bbe2-4af4-9a57-9ee76a91c71e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.201705 Feb 15 14:28:01.189973 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 278/548] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:00 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:01.360368 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-c327be1c-ad88-4636-8c5f-2707ef0670d3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:01.370368 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-c327be1c-ad88-4636-8c5f-2707ef0670d3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:01.371885 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-c327be1c-ad88-4636-8c5f-2707ef0670d3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:01.373118 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-c327be1c-ad88-4636-8c5f-2707ef0670d3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1807 microversion: 2.20 time: 0.257621 Feb 15 14:28:01.373675 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 271/549] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:28:01 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1807 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 14:28:01.763988 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-d970d8ec-955e-479d-be24-1ed3cd69c17f tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:01.764932 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-d970d8ec-955e-479d-be24-1ed3cd69c17f tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:01.770845 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d970d8ec-955e-479d-be24-1ed3cd69c17f tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:01.771370 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d970d8ec-955e-479d-be24-1ed3cd69c17f tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:01.772992 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d970d8ec-955e-479d-be24-1ed3cd69c17f tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:01.773411 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d970d8ec-955e-479d-be24-1ed3cd69c17f tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:01.932793 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-d970d8ec-955e-479d-be24-1ed3cd69c17f tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:01.941166 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-d970d8ec-955e-479d-be24-1ed3cd69c17f tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.180791 Feb 15 14:28:01.941756 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 279/550] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:01 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:02.206808 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-81366726-ed85-44c3-867b-6c21f565c23d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:02.207573 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-81366726-ed85-44c3-867b-6c21f565c23d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:02.222395 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-81366726-ed85-44c3-867b-6c21f565c23d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:02.222855 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-81366726-ed85-44c3-867b-6c21f565c23d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:02.223670 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-81366726-ed85-44c3-867b-6c21f565c23d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:02.224100 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-81366726-ed85-44c3-867b-6c21f565c23d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:02.391767 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-06db1094-261d-4ed1-ae7c-2a1a7b8422ec tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:02.393036 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-06db1094-261d-4ed1-ae7c-2a1a7b8422ec tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:02.400355 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-06db1094-261d-4ed1-ae7c-2a1a7b8422ec tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:02.401090 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-06db1094-261d-4ed1-ae7c-2a1a7b8422ec tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:02.401409 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-81366726-ed85-44c3-867b-6c21f565c23d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:02.402233 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-06db1094-261d-4ed1-ae7c-2a1a7b8422ec tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:02.402820 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-06db1094-261d-4ed1-ae7c-2a1a7b8422ec tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:02.411268 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-81366726-ed85-44c3-867b-6c21f565c23d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.208611 Feb 15 14:28:02.412914 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 272/551] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:02 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:02.547064 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-06db1094-261d-4ed1-ae7c-2a1a7b8422ec tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:02.556500 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-06db1094-261d-4ed1-ae7c-2a1a7b8422ec tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:02.558009 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-06db1094-261d-4ed1-ae7c-2a1a7b8422ec tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:02.559170 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-06db1094-261d-4ed1-ae7c-2a1a7b8422ec tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1807 microversion: 2.20 time: 0.171646 Feb 15 14:28:02.559922 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 280/552] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:28:02 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 14:28:02.957695 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-7a2a4cb6-2f53-4eee-bfe3-52fb74672b59 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:02.958305 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-7a2a4cb6-2f53-4eee-bfe3-52fb74672b59 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:02.965134 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7a2a4cb6-2f53-4eee-bfe3-52fb74672b59 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:02.965584 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7a2a4cb6-2f53-4eee-bfe3-52fb74672b59 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:02.966367 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7a2a4cb6-2f53-4eee-bfe3-52fb74672b59 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:02.966799 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7a2a4cb6-2f53-4eee-bfe3-52fb74672b59 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:03.117644 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-7a2a4cb6-2f53-4eee-bfe3-52fb74672b59 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:03.125121 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-7a2a4cb6-2f53-4eee-bfe3-52fb74672b59 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.171073 Feb 15 14:28:03.125905 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 273/553] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:02 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:03.429803 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-4cec8500-ee6d-4f3e-91aa-8ad8b8e7f476 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:03.431164 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-4cec8500-ee6d-4f3e-91aa-8ad8b8e7f476 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:03.437991 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4cec8500-ee6d-4f3e-91aa-8ad8b8e7f476 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:03.438694 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4cec8500-ee6d-4f3e-91aa-8ad8b8e7f476 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:03.439661 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4cec8500-ee6d-4f3e-91aa-8ad8b8e7f476 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:03.440558 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4cec8500-ee6d-4f3e-91aa-8ad8b8e7f476 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:03.577777 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-23c2af0f-46a9-46db-ba0e-fab0b9296c55 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:03.579237 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-23c2af0f-46a9-46db-ba0e-fab0b9296c55 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:03.587886 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-23c2af0f-46a9-46db-ba0e-fab0b9296c55 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:03.588322 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-23c2af0f-46a9-46db-ba0e-fab0b9296c55 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:03.589312 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-23c2af0f-46a9-46db-ba0e-fab0b9296c55 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:03.589724 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-23c2af0f-46a9-46db-ba0e-fab0b9296c55 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:03.656324 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-4cec8500-ee6d-4f3e-91aa-8ad8b8e7f476 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:03.667920 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-4cec8500-ee6d-4f3e-91aa-8ad8b8e7f476 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.241729 Feb 15 14:28:03.669240 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 281/554] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:03 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:28:03.943059 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-23c2af0f-46a9-46db-ba0e-fab0b9296c55 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:03.954216 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-23c2af0f-46a9-46db-ba0e-fab0b9296c55 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:03.955722 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-23c2af0f-46a9-46db-ba0e-fab0b9296c55 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:03.957014 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-23c2af0f-46a9-46db-ba0e-fab0b9296c55 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1807 microversion: 2.20 time: 0.383369 Feb 15 14:28:03.957580 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 274/555] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:28:03 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1807 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 14:28:04.142486 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-6dee5a71-8af3-4fae-a7a1-5c90d92f9b8b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:04.143022 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-6dee5a71-8af3-4fae-a7a1-5c90d92f9b8b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:04.149776 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6dee5a71-8af3-4fae-a7a1-5c90d92f9b8b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:04.150483 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6dee5a71-8af3-4fae-a7a1-5c90d92f9b8b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:04.151496 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6dee5a71-8af3-4fae-a7a1-5c90d92f9b8b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:04.152162 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6dee5a71-8af3-4fae-a7a1-5c90d92f9b8b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:04.298282 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-6dee5a71-8af3-4fae-a7a1-5c90d92f9b8b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:04.320429 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-6dee5a71-8af3-4fae-a7a1-5c90d92f9b8b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.181680 Feb 15 14:28:04.321269 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 282/556] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:04 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:04.685695 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-5e404f7d-935d-4bda-bf5d-dfb9871c30d3 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:04.686298 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-5e404f7d-935d-4bda-bf5d-dfb9871c30d3 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:04.692635 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5e404f7d-935d-4bda-bf5d-dfb9871c30d3 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:04.693087 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5e404f7d-935d-4bda-bf5d-dfb9871c30d3 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:04.693863 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5e404f7d-935d-4bda-bf5d-dfb9871c30d3 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:04.694295 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5e404f7d-935d-4bda-bf5d-dfb9871c30d3 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:04.834701 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-5e404f7d-935d-4bda-bf5d-dfb9871c30d3 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:04.843241 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-5e404f7d-935d-4bda-bf5d-dfb9871c30d3 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.161174 Feb 15 14:28:04.846754 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 275/557] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:04 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:04.975875 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-3ed368a6-de94-489d-bb10-a3abbb4b0e19 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:04.976540 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-3ed368a6-de94-489d-bb10-a3abbb4b0e19 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:04.983101 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3ed368a6-de94-489d-bb10-a3abbb4b0e19 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:04.983558 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3ed368a6-de94-489d-bb10-a3abbb4b0e19 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:04.984345 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3ed368a6-de94-489d-bb10-a3abbb4b0e19 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:04.984801 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3ed368a6-de94-489d-bb10-a3abbb4b0e19 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:05.145453 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-3ed368a6-de94-489d-bb10-a3abbb4b0e19 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:05.154564 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-3ed368a6-de94-489d-bb10-a3abbb4b0e19 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:05.156036 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-3ed368a6-de94-489d-bb10-a3abbb4b0e19 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:05.157445 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-3ed368a6-de94-489d-bb10-a3abbb4b0e19 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1807 microversion: 2.20 time: 0.186116 Feb 15 14:28:05.158005 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 283/558] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:28:04 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:28:05.337240 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-6d99908a-92f8-44ca-818c-280606ca6701 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:05.337858 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-6d99908a-92f8-44ca-818c-280606ca6701 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:05.344342 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6d99908a-92f8-44ca-818c-280606ca6701 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:05.344853 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6d99908a-92f8-44ca-818c-280606ca6701 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:05.345680 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6d99908a-92f8-44ca-818c-280606ca6701 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:05.346122 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6d99908a-92f8-44ca-818c-280606ca6701 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:05.527803 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-6d99908a-92f8-44ca-818c-280606ca6701 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:05.536194 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-6d99908a-92f8-44ca-818c-280606ca6701 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.202785 Feb 15 14:28:05.537568 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 276/559] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:05 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:05.861105 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-d77548ec-1b52-4417-a6be-0c41a10ff136 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:05.861700 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-d77548ec-1b52-4417-a6be-0c41a10ff136 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:05.868694 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d77548ec-1b52-4417-a6be-0c41a10ff136 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:05.869147 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d77548ec-1b52-4417-a6be-0c41a10ff136 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:05.869935 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d77548ec-1b52-4417-a6be-0c41a10ff136 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:05.870377 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d77548ec-1b52-4417-a6be-0c41a10ff136 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:06.007705 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-d77548ec-1b52-4417-a6be-0c41a10ff136 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:06.015637 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-d77548ec-1b52-4417-a6be-0c41a10ff136 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.158046 Feb 15 14:28:06.016218 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 284/560] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:05 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:28:06.175976 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-672eeae0-f4d9-465f-94de-7c4ad259f8cc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:06.176894 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-672eeae0-f4d9-465f-94de-7c4ad259f8cc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:06.183573 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-672eeae0-f4d9-465f-94de-7c4ad259f8cc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:06.184024 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-672eeae0-f4d9-465f-94de-7c4ad259f8cc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:06.184844 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-672eeae0-f4d9-465f-94de-7c4ad259f8cc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:06.185280 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-672eeae0-f4d9-465f-94de-7c4ad259f8cc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:06.325218 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-672eeae0-f4d9-465f-94de-7c4ad259f8cc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:06.334959 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-672eeae0-f4d9-465f-94de-7c4ad259f8cc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:06.336690 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-672eeae0-f4d9-465f-94de-7c4ad259f8cc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:06.337851 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-672eeae0-f4d9-465f-94de-7c4ad259f8cc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1807 microversion: 2.20 time: 0.165653 Feb 15 14:28:06.338408 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 277/561] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:28:06 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 14:28:06.553678 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-6b0e811b-3508-44ab-8c92-c701e9f73f97 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:06.554323 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-6b0e811b-3508-44ab-8c92-c701e9f73f97 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:06.560480 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6b0e811b-3508-44ab-8c92-c701e9f73f97 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:06.560932 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6b0e811b-3508-44ab-8c92-c701e9f73f97 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:06.561715 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6b0e811b-3508-44ab-8c92-c701e9f73f97 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:06.562148 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6b0e811b-3508-44ab-8c92-c701e9f73f97 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:06.706270 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-6b0e811b-3508-44ab-8c92-c701e9f73f97 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:06.714774 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-6b0e811b-3508-44ab-8c92-c701e9f73f97 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.165167 Feb 15 14:28:06.715687 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 285/562] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:06 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:07.033741 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-1ac3b913-3e66-4de6-9819-0c3df2003b11 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:07.034345 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-1ac3b913-3e66-4de6-9819-0c3df2003b11 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:07.040905 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1ac3b913-3e66-4de6-9819-0c3df2003b11 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:07.041349 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1ac3b913-3e66-4de6-9819-0c3df2003b11 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:07.042117 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1ac3b913-3e66-4de6-9819-0c3df2003b11 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:07.042548 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1ac3b913-3e66-4de6-9819-0c3df2003b11 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:07.177812 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-1ac3b913-3e66-4de6-9819-0c3df2003b11 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:07.186962 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-1ac3b913-3e66-4de6-9819-0c3df2003b11 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.157133 Feb 15 14:28:07.197226 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 278/563] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:07 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:28:07.355363 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-4c2913e9-bc93-43de-8e49-d1654d41666a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:07.356068 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-4c2913e9-bc93-43de-8e49-d1654d41666a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:07.362467 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4c2913e9-bc93-43de-8e49-d1654d41666a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:07.362911 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4c2913e9-bc93-43de-8e49-d1654d41666a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:07.363929 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4c2913e9-bc93-43de-8e49-d1654d41666a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:07.364598 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4c2913e9-bc93-43de-8e49-d1654d41666a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:07.508341 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-4c2913e9-bc93-43de-8e49-d1654d41666a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:07.517406 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-4c2913e9-bc93-43de-8e49-d1654d41666a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:07.518954 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-4c2913e9-bc93-43de-8e49-d1654d41666a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:07.520129 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-4c2913e9-bc93-43de-8e49-d1654d41666a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1807 microversion: 2.20 time: 0.168718 Feb 15 14:28:07.520978 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 286/564] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:28:07 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:28:07.731397 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-07ffc075-f4cd-4363-ae2b-e6ee724fa99b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:07.732011 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-07ffc075-f4cd-4363-ae2b-e6ee724fa99b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:07.738051 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-07ffc075-f4cd-4363-ae2b-e6ee724fa99b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:07.738522 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-07ffc075-f4cd-4363-ae2b-e6ee724fa99b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:07.739293 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-07ffc075-f4cd-4363-ae2b-e6ee724fa99b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:07.739729 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-07ffc075-f4cd-4363-ae2b-e6ee724fa99b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:07.893688 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-07ffc075-f4cd-4363-ae2b-e6ee724fa99b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:07.901222 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-07ffc075-f4cd-4363-ae2b-e6ee724fa99b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1358 microversion: 2.1 time: 0.173483 Feb 15 14:28:07.901788 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 279/565] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:07 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:08.204661 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-b98cdc99-3235-493d-a88d-3ce78a704a15 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:08.205268 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-b98cdc99-3235-493d-a88d-3ce78a704a15 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:08.211233 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b98cdc99-3235-493d-a88d-3ce78a704a15 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:08.211683 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b98cdc99-3235-493d-a88d-3ce78a704a15 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:08.212482 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b98cdc99-3235-493d-a88d-3ce78a704a15 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:08.212922 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b98cdc99-3235-493d-a88d-3ce78a704a15 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:08.356284 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-b98cdc99-3235-493d-a88d-3ce78a704a15 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:08.365187 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-b98cdc99-3235-493d-a88d-3ce78a704a15 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.163967 Feb 15 14:28:08.365941 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 287/566] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:08 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:08.540460 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-6350b47d-e3f0-4fd5-8784-815e70322b5d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:08.541068 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-6350b47d-e3f0-4fd5-8784-815e70322b5d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:08.547444 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6350b47d-e3f0-4fd5-8784-815e70322b5d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:08.547834 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6350b47d-e3f0-4fd5-8784-815e70322b5d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:08.548629 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6350b47d-e3f0-4fd5-8784-815e70322b5d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:08.549066 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6350b47d-e3f0-4fd5-8784-815e70322b5d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:08.680015 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-6350b47d-e3f0-4fd5-8784-815e70322b5d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:08.688722 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-6350b47d-e3f0-4fd5-8784-815e70322b5d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:08.690195 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-6350b47d-e3f0-4fd5-8784-815e70322b5d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:08.691330 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-6350b47d-e3f0-4fd5-8784-815e70322b5d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1807 microversion: 2.20 time: 0.154628 Feb 15 14:28:08.691879 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 280/567] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:28:08 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:28:08.918741 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-648ce693-d6be-49cf-ad97-92613fa6cc12 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:08.919341 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-648ce693-d6be-49cf-ad97-92613fa6cc12 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:08.925174 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-648ce693-d6be-49cf-ad97-92613fa6cc12 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:08.925613 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-648ce693-d6be-49cf-ad97-92613fa6cc12 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:08.926373 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-648ce693-d6be-49cf-ad97-92613fa6cc12 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:08.926801 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-648ce693-d6be-49cf-ad97-92613fa6cc12 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:09.062340 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-648ce693-d6be-49cf-ad97-92613fa6cc12 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:09.070247 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-648ce693-d6be-49cf-ad97-92613fa6cc12 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1548 microversion: 2.1 time: 0.154994 Feb 15 14:28:09.070851 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 288/568] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:08 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:09.086328 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-a15165d9-bcaa-439b-b9b2-6252f53a890e tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:09.086934 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-a15165d9-bcaa-439b-b9b2-6252f53a890e tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:09.093014 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a15165d9-bcaa-439b-b9b2-6252f53a890e tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:09.093391 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a15165d9-bcaa-439b-b9b2-6252f53a890e tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:09.094327 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a15165d9-bcaa-439b-b9b2-6252f53a890e tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:09.094950 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a15165d9-bcaa-439b-b9b2-6252f53a890e tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:09.232608 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-a15165d9-bcaa-439b-b9b2-6252f53a890e tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:09.239902 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-a15165d9-bcaa-439b-b9b2-6252f53a890e tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1548 microversion: 2.1 time: 0.157626 Feb 15 14:28:09.240491 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 281/569] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:09 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:09.255221 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-2470c5c6-4f73-4a04-b222-d322de5459f2 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:09.259006 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:28:09.259006 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:28:09.260047 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-2470c5c6-4f73-4a04-b222-d322de5459f2 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:09.260860 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-2470c5c6-4f73-4a04-b222-d322de5459f2 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Searching by: {'deleted': False, 'project_id': '4b838dafad384c2a9df8223904cffd5c'} {{(pid=116363) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 15 14:28:09.267278 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2470c5c6-4f73-4a04-b222-d322de5459f2 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:09.267736 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2470c5c6-4f73-4a04-b222-d322de5459f2 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:09.268656 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2470c5c6-4f73-4a04-b222-d322de5459f2 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:09.269084 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2470c5c6-4f73-4a04-b222-d322de5459f2 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:09.362073 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.multi_cell_list [None req-2470c5c6-4f73-4a04-b222-d322de5459f2 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116363) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 15 14:28:09.382340 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-020c4eef-ae06-490b-9791-bcd3169f7dba tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:09.382949 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-020c4eef-ae06-490b-9791-bcd3169f7dba tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:09.388762 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-020c4eef-ae06-490b-9791-bcd3169f7dba tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:09.389208 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-020c4eef-ae06-490b-9791-bcd3169f7dba tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:09.389990 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-020c4eef-ae06-490b-9791-bcd3169f7dba tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:09.390423 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-020c4eef-ae06-490b-9791-bcd3169f7dba tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:09.458288 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-2470c5c6-4f73-4a04-b222-d322de5459f2 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.206387 Feb 15 14:28:09.459773 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 289/570] 10.222.0.83 () {58 vars in 1124 bytes} [Tue Feb 15 14:28:09 2022] GET /compute/v2.1/servers => generated 343 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:28:09.469668 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-54b54a85-1c38-4726-91f2-7dfbc371e840 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:09.470575 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-54b54a85-1c38-4726-91f2-7dfbc371e840 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:09.477198 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-54b54a85-1c38-4726-91f2-7dfbc371e840 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:09.477650 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-54b54a85-1c38-4726-91f2-7dfbc371e840 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:09.478604 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-54b54a85-1c38-4726-91f2-7dfbc371e840 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:09.479047 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-54b54a85-1c38-4726-91f2-7dfbc371e840 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:09.539497 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-020c4eef-ae06-490b-9791-bcd3169f7dba tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:09.547996 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-020c4eef-ae06-490b-9791-bcd3169f7dba tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.169441 Feb 15 14:28:09.548694 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 282/571] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:09 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:28:09.675561 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-54b54a85-1c38-4726-91f2-7dfbc371e840 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:09.682960 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-54b54a85-1c38-4726-91f2-7dfbc371e840 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1548 microversion: 2.1 time: 0.217178 Feb 15 14:28:09.683525 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 290/572] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:09 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1548 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:09.710311 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-3b224edb-6003-4f9a-9ef5-bc5c5c945776 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:09.710859 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-3b224edb-6003-4f9a-9ef5-bc5c5c945776 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:09.716665 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3b224edb-6003-4f9a-9ef5-bc5c5c945776 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:09.717114 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3b224edb-6003-4f9a-9ef5-bc5c5c945776 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:09.717888 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3b224edb-6003-4f9a-9ef5-bc5c5c945776 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:09.718323 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3b224edb-6003-4f9a-9ef5-bc5c5c945776 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:09.857304 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-3b224edb-6003-4f9a-9ef5-bc5c5c945776 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:09.865762 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-3b224edb-6003-4f9a-9ef5-bc5c5c945776 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:09.867257 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-3b224edb-6003-4f9a-9ef5-bc5c5c945776 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:09.868443 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-3b224edb-6003-4f9a-9ef5-bc5c5c945776 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1807 microversion: 2.20 time: 0.162387 Feb 15 14:28:09.869003 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 283/573] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:28:09 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:28:10.564747 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-60f49691-9f07-45b3-9270-63b0d1a6604a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:10.565354 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-60f49691-9f07-45b3-9270-63b0d1a6604a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:10.571881 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-60f49691-9f07-45b3-9270-63b0d1a6604a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:10.572329 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-60f49691-9f07-45b3-9270-63b0d1a6604a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:10.573161 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-60f49691-9f07-45b3-9270-63b0d1a6604a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:10.573582 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-60f49691-9f07-45b3-9270-63b0d1a6604a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:10.759698 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-60f49691-9f07-45b3-9270-63b0d1a6604a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:10.767465 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-60f49691-9f07-45b3-9270-63b0d1a6604a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1567 microversion: 2.1 time: 0.206324 Feb 15 14:28:10.768149 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 291/574] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:10 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:10.886806 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-dc08be37-b995-493e-94ba-31dd634913e9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:10.887909 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-dc08be37-b995-493e-94ba-31dd634913e9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:10.894154 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-dc08be37-b995-493e-94ba-31dd634913e9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:10.894826 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-dc08be37-b995-493e-94ba-31dd634913e9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:10.895653 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-dc08be37-b995-493e-94ba-31dd634913e9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:10.896323 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-dc08be37-b995-493e-94ba-31dd634913e9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:11.058260 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-dc08be37-b995-493e-94ba-31dd634913e9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:11.068256 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-dc08be37-b995-493e-94ba-31dd634913e9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:11.071284 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-dc08be37-b995-493e-94ba-31dd634913e9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:11.073498 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-dc08be37-b995-493e-94ba-31dd634913e9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1807 microversion: 2.20 time: 0.189277 Feb 15 14:28:11.074075 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 284/575] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:28:10 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:28:11.203898 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-d4a68624-647a-480b-8f35-62c372105be1 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "affc90e6-d313-47c4-9285-92d51af2e337"}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:28:11.205013 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-d4a68624-647a-480b-8f35-62c372105be1 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:11.211017 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d4a68624-647a-480b-8f35-62c372105be1 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:11.211464 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d4a68624-647a-480b-8f35-62c372105be1 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:11.212458 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d4a68624-647a-480b-8f35-62c372105be1 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:11.212895 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d4a68624-647a-480b-8f35-62c372105be1 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:11.469809 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-d4a68624-647a-480b-8f35-62c372105be1 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "POST /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269602 Feb 15 14:28:11.470793 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 292/576] 10.222.0.83 () {60 vars in 1322 bytes} [Tue Feb 15 14:28:11 2022] POST /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:28:11.785386 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-a1453d58-8561-46b9-9fc8-d40413a18175 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:11.785999 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-a1453d58-8561-46b9-9fc8-d40413a18175 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:11.792690 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a1453d58-8561-46b9-9fc8-d40413a18175 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:11.793200 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a1453d58-8561-46b9-9fc8-d40413a18175 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:11.794297 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a1453d58-8561-46b9-9fc8-d40413a18175 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:11.794716 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a1453d58-8561-46b9-9fc8-d40413a18175 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:11.942367 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-a1453d58-8561-46b9-9fc8-d40413a18175 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:11.951211 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-a1453d58-8561-46b9-9fc8-d40413a18175 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1547 microversion: 2.1 time: 0.169643 Feb 15 14:28:11.951836 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 285/577] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:11 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1547 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:11.968760 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-e17b1e50-6a47-4a41-a90e-d05bb0840933 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:11.969459 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-e17b1e50-6a47-4a41-a90e-d05bb0840933 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:11.976096 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e17b1e50-6a47-4a41-a90e-d05bb0840933 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:11.976574 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e17b1e50-6a47-4a41-a90e-d05bb0840933 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:11.977353 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e17b1e50-6a47-4a41-a90e-d05bb0840933 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:11.977781 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e17b1e50-6a47-4a41-a90e-d05bb0840933 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:12.059399 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.wsgi [None req-e17b1e50-6a47-4a41-a90e-d05bb0840933 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] HTTP exception thrown: Cannot 'detach_volume' instance 13edf4fd-20da-43ce-bb58-5757dc0f96c7 while it is in vm_state rescued Feb 15 14:28:12.060126 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-e17b1e50-6a47-4a41-a90e-d05bb0840933 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Returning 409 to user: Cannot 'detach_volume' instance 13edf4fd-20da-43ce-bb58-5757dc0f96c7 while it is in vm_state rescued {{(pid=116363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:28:12.060988 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-e17b1e50-6a47-4a41-a90e-d05bb0840933 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "DELETE /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/os-volume_attachments/5d43a941-df96-4136-ba96-541da47001d5" status: 409 len: 152 microversion: 2.1 time: 0.096504 Feb 15 14:28:12.061628 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 293/578] 10.222.0.83 () {58 vars in 1415 bytes} [Tue Feb 15 14:28:11 2022] DELETE /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/os-volume_attachments/5d43a941-df96-4136-ba96-541da47001d5 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 15 14:28:12.070661 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-89e2eb91-a32a-4727-9b55-688bbf492e2c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:28:12.071190 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-89e2eb91-a32a-4727-9b55-688bbf492e2c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:12.077114 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-89e2eb91-a32a-4727-9b55-688bbf492e2c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:12.077563 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-89e2eb91-a32a-4727-9b55-688bbf492e2c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:12.078340 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-89e2eb91-a32a-4727-9b55-688bbf492e2c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:12.078770 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-89e2eb91-a32a-4727-9b55-688bbf492e2c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:12.091299 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-d6c912d4-fa2f-4c72-a6cd-c0bc2adfbfa2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:12.091913 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-d6c912d4-fa2f-4c72-a6cd-c0bc2adfbfa2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:12.097746 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d6c912d4-fa2f-4c72-a6cd-c0bc2adfbfa2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:12.098438 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d6c912d4-fa2f-4c72-a6cd-c0bc2adfbfa2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:12.099418 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d6c912d4-fa2f-4c72-a6cd-c0bc2adfbfa2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:12.099876 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d6c912d4-fa2f-4c72-a6cd-c0bc2adfbfa2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:12.154177 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-89e2eb91-a32a-4727-9b55-688bbf492e2c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "POST /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/action" status: 202 len: 0 microversion: 2.1 time: 0.087774 Feb 15 14:28:12.155261 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 286/579] 10.222.0.83 () {60 vars in 1277 bytes} [Tue Feb 15 14:28:12 2022] POST /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 15 14:28:12.166394 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-da4882e3-4951-46cf-89df-434c824f007d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:12.167321 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-da4882e3-4951-46cf-89df-434c824f007d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:12.175263 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-da4882e3-4951-46cf-89df-434c824f007d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:12.175717 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-da4882e3-4951-46cf-89df-434c824f007d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:12.176981 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-da4882e3-4951-46cf-89df-434c824f007d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:12.177993 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-da4882e3-4951-46cf-89df-434c824f007d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:12.308792 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-d6c912d4-fa2f-4c72-a6cd-c0bc2adfbfa2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:12.319403 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-d6c912d4-fa2f-4c72-a6cd-c0bc2adfbfa2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:12.321064 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-d6c912d4-fa2f-4c72-a6cd-c0bc2adfbfa2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:12.322213 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-d6c912d4-fa2f-4c72-a6cd-c0bc2adfbfa2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1807 microversion: 2.20 time: 0.234835 Feb 15 14:28:12.322977 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 294/580] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:28:12 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1807 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 14:28:12.335849 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-da4882e3-4951-46cf-89df-434c824f007d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:12.343728 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-da4882e3-4951-46cf-89df-434c824f007d tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1555 microversion: 2.1 time: 0.182247 Feb 15 14:28:12.344306 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 287/581] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:12 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1555 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:13.341101 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-7b084b48-6e9a-4b93-a34c-455aa01652a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:13.341713 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-7b084b48-6e9a-4b93-a34c-455aa01652a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:13.348027 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7b084b48-6e9a-4b93-a34c-455aa01652a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:13.348535 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7b084b48-6e9a-4b93-a34c-455aa01652a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:13.349499 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7b084b48-6e9a-4b93-a34c-455aa01652a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:13.349996 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7b084b48-6e9a-4b93-a34c-455aa01652a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:13.360820 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-3e37ec4b-c0df-44f5-beae-7c03f898452e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:13.361435 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-3e37ec4b-c0df-44f5-beae-7c03f898452e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:13.367945 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3e37ec4b-c0df-44f5-beae-7c03f898452e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:13.368431 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3e37ec4b-c0df-44f5-beae-7c03f898452e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:13.369215 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3e37ec4b-c0df-44f5-beae-7c03f898452e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:13.369653 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3e37ec4b-c0df-44f5-beae-7c03f898452e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:13.488757 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-7b084b48-6e9a-4b93-a34c-455aa01652a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:13.500455 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-7b084b48-6e9a-4b93-a34c-455aa01652a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:13.501954 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-7b084b48-6e9a-4b93-a34c-455aa01652a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:13.503102 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-7b084b48-6e9a-4b93-a34c-455aa01652a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1807 microversion: 2.20 time: 0.165766 Feb 15 14:28:13.503665 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 295/582] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:28:13 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:28:13.516878 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-3e37ec4b-c0df-44f5-beae-7c03f898452e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:13.525349 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-3e37ec4b-c0df-44f5-beae-7c03f898452e tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1555 microversion: 2.1 time: 0.168139 Feb 15 14:28:13.525919 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 288/583] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:13 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:28:14.522766 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-37d62abe-5d65-4b4e-bb89-ffb458c18539 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:14.523277 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-37d62abe-5d65-4b4e-bb89-ffb458c18539 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:14.529662 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-37d62abe-5d65-4b4e-bb89-ffb458c18539 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:14.530114 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-37d62abe-5d65-4b4e-bb89-ffb458c18539 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:14.530894 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-37d62abe-5d65-4b4e-bb89-ffb458c18539 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:14.531582 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-37d62abe-5d65-4b4e-bb89-ffb458c18539 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:14.542503 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-d94e171a-8465-4435-9518-b34e5b2fe3d8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:14.543099 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-d94e171a-8465-4435-9518-b34e5b2fe3d8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:14.549349 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d94e171a-8465-4435-9518-b34e5b2fe3d8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:14.549794 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d94e171a-8465-4435-9518-b34e5b2fe3d8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:14.550561 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d94e171a-8465-4435-9518-b34e5b2fe3d8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:14.550991 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d94e171a-8465-4435-9518-b34e5b2fe3d8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:14.674018 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-37d62abe-5d65-4b4e-bb89-ffb458c18539 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:14.682518 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-37d62abe-5d65-4b4e-bb89-ffb458c18539 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:14.684680 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-37d62abe-5d65-4b4e-bb89-ffb458c18539 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:14.685848 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-37d62abe-5d65-4b4e-bb89-ffb458c18539 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1807 microversion: 2.20 time: 0.167843 Feb 15 14:28:14.686397 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 296/584] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:28:14 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:28:14.689474 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-d94e171a-8465-4435-9518-b34e5b2fe3d8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:14.697396 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-d94e171a-8465-4435-9518-b34e5b2fe3d8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1555 microversion: 2.1 time: 0.158623 Feb 15 14:28:14.697969 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 289/585] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:14 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:28:15.703312 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-95139bfb-0002-4951-a199-794c0a768799 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:15.704002 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-95139bfb-0002-4951-a199-794c0a768799 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:15.710633 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-95139bfb-0002-4951-a199-794c0a768799 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:15.711340 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-95139bfb-0002-4951-a199-794c0a768799 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:15.712299 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-95139bfb-0002-4951-a199-794c0a768799 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:15.713018 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-95139bfb-0002-4951-a199-794c0a768799 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:15.715577 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-2f4f6298-c2ac-438d-9ca4-3b16c808d49a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:15.716491 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-2f4f6298-c2ac-438d-9ca4-3b16c808d49a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:15.724845 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2f4f6298-c2ac-438d-9ca4-3b16c808d49a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:15.725883 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2f4f6298-c2ac-438d-9ca4-3b16c808d49a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:15.726984 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2f4f6298-c2ac-438d-9ca4-3b16c808d49a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:15.727512 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2f4f6298-c2ac-438d-9ca4-3b16c808d49a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:15.856231 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-95139bfb-0002-4951-a199-794c0a768799 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:15.865333 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-95139bfb-0002-4951-a199-794c0a768799 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:15.866857 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-95139bfb-0002-4951-a199-794c0a768799 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:15.868019 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-95139bfb-0002-4951-a199-794c0a768799 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1807 microversion: 2.20 time: 0.168379 Feb 15 14:28:15.868844 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-2f4f6298-c2ac-438d-9ca4-3b16c808d49a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:15.869002 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 297/586] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:28:15 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:28:15.877177 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-2f4f6298-c2ac-438d-9ca4-3b16c808d49a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1561 microversion: 2.1 time: 0.166233 Feb 15 14:28:15.883063 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 290/587] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:15 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:28:15.945379 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-0e48aa1b-7905-4580-b8c8-3d6844d03477 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:15.945868 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-0e48aa1b-7905-4580-b8c8-3d6844d03477 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:15.951754 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0e48aa1b-7905-4580-b8c8-3d6844d03477 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:15.952138 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0e48aa1b-7905-4580-b8c8-3d6844d03477 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:15.952928 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0e48aa1b-7905-4580-b8c8-3d6844d03477 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:15.953365 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0e48aa1b-7905-4580-b8c8-3d6844d03477 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:16.030468 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.objects.instance [None req-0e48aa1b-7905-4580-b8c8-3d6844d03477 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lazy-loading 'services' on Instance uuid 13edf4fd-20da-43ce-bb58-5757dc0f96c7 {{(pid=116363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:28:16.099255 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-0e48aa1b-7905-4580-b8c8-3d6844d03477 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "DELETE /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/os-volume_attachments/5d43a941-df96-4136-ba96-541da47001d5" status: 202 len: 0 microversion: 2.1 time: 0.157649 Feb 15 14:28:16.099891 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 298/588] 10.222.0.83 () {58 vars in 1415 bytes} [Tue Feb 15 14:28:15 2022] DELETE /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/os-volume_attachments/5d43a941-df96-4136-ba96-541da47001d5 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:28:16.108729 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-a1757266-abaf-4831-997f-281d7817193f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:16.109797 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-a1757266-abaf-4831-997f-281d7817193f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:16.116687 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a1757266-abaf-4831-997f-281d7817193f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:16.117222 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a1757266-abaf-4831-997f-281d7817193f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:16.118071 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a1757266-abaf-4831-997f-281d7817193f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:16.118578 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a1757266-abaf-4831-997f-281d7817193f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:16.149053 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-a1757266-abaf-4831-997f-281d7817193f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044672 Feb 15 14:28:16.149632 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 291/589] 10.222.0.83 () {58 vars in 1301 bytes} [Tue Feb 15 14:28:16 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:28:16.887622 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-6e148df8-df1b-4c20-8e80-9ecb82109d8d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:16.888621 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-6e148df8-df1b-4c20-8e80-9ecb82109d8d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:16.896454 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6e148df8-df1b-4c20-8e80-9ecb82109d8d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:16.896947 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6e148df8-df1b-4c20-8e80-9ecb82109d8d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:16.897775 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6e148df8-df1b-4c20-8e80-9ecb82109d8d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:16.898228 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6e148df8-df1b-4c20-8e80-9ecb82109d8d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:17.037621 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-6e148df8-df1b-4c20-8e80-9ecb82109d8d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:17.046269 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-6e148df8-df1b-4c20-8e80-9ecb82109d8d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:17.047540 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-6e148df8-df1b-4c20-8e80-9ecb82109d8d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:17.048721 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-6e148df8-df1b-4c20-8e80-9ecb82109d8d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1807 microversion: 2.20 time: 0.165822 Feb 15 14:28:17.049293 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 299/590] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:28:16 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:28:17.161016 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-b4dd213b-9d00-4f1a-a31e-584f9e26e9d1 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:17.162377 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-b4dd213b-9d00-4f1a-a31e-584f9e26e9d1 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:17.168845 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b4dd213b-9d00-4f1a-a31e-584f9e26e9d1 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:17.169298 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b4dd213b-9d00-4f1a-a31e-584f9e26e9d1 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:17.170085 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b4dd213b-9d00-4f1a-a31e-584f9e26e9d1 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:17.170523 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b4dd213b-9d00-4f1a-a31e-584f9e26e9d1 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:17.201539 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-b4dd213b-9d00-4f1a-a31e-584f9e26e9d1 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044416 Feb 15 14:28:17.202097 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 292/591] 10.222.0.83 () {58 vars in 1301 bytes} [Tue Feb 15 14:28:17 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:28:18.066584 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-078cacb9-e656-492f-876e-b968a95cf677 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:18.067169 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-078cacb9-e656-492f-876e-b968a95cf677 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:18.073455 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-078cacb9-e656-492f-876e-b968a95cf677 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:18.073897 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-078cacb9-e656-492f-876e-b968a95cf677 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:18.074695 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-078cacb9-e656-492f-876e-b968a95cf677 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:18.075085 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-078cacb9-e656-492f-876e-b968a95cf677 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:18.214661 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-aaa20fba-954a-4a01-8549-e56afa680232 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:18.216379 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-aaa20fba-954a-4a01-8549-e56afa680232 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:18.219855 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-078cacb9-e656-492f-876e-b968a95cf677 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:18.223468 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-aaa20fba-954a-4a01-8549-e56afa680232 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:18.224739 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-aaa20fba-954a-4a01-8549-e56afa680232 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:18.225550 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-aaa20fba-954a-4a01-8549-e56afa680232 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:18.225987 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-aaa20fba-954a-4a01-8549-e56afa680232 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:18.232478 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-078cacb9-e656-492f-876e-b968a95cf677 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:18.234022 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-078cacb9-e656-492f-876e-b968a95cf677 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:18.235223 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-078cacb9-e656-492f-876e-b968a95cf677 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1807 microversion: 2.20 time: 0.172406 Feb 15 14:28:18.236002 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 300/592] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:28:18 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:28:18.255954 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-aaa20fba-954a-4a01-8549-e56afa680232 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045514 Feb 15 14:28:18.256539 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 293/593] 10.222.0.83 () {58 vars in 1301 bytes} [Tue Feb 15 14:28:18 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:28:18.474529 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-6be548ac-8eed-4bfc-8aba-348de8de6ddf req-d302d194-1bef-40c7-aa60-7be085fe3c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c04d927-9f34-4f11-8502-7175a64e3923", "name": "network-vif-plugged", "status": "completed", "tag": "23ef841c-69a3-483c-9bb9-680e3d5b6392"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:28:18.476183 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:28:18.476183 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:28:18.482987 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-6be548ac-8eed-4bfc-8aba-348de8de6ddf req-d302d194-1bef-40c7-aa60-7be085fe3c8a service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:18.483416 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-6be548ac-8eed-4bfc-8aba-348de8de6ddf req-d302d194-1bef-40c7-aa60-7be085fe3c8a service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:18.494422 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-6be548ac-8eed-4bfc-8aba-348de8de6ddf req-d302d194-1bef-40c7-aa60-7be085fe3c8a service nova] Creating event network-vif-plugged:23ef841c-69a3-483c-9bb9-680e3d5b6392 for instance 9c04d927-9f34-4f11-8502-7175a64e3923 on hv-cinder-81914 Feb 15 14:28:18.499047 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-6be548ac-8eed-4bfc-8aba-348de8de6ddf req-d302d194-1bef-40c7-aa60-7be085fe3c8a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030324 Feb 15 14:28:18.499628 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 301/594] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:28:19.006091 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-c5561595-8c27-4282-bfcf-58ef3a12214c tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:19.006702 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-c5561595-8c27-4282-bfcf-58ef3a12214c tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:19.012846 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c5561595-8c27-4282-bfcf-58ef3a12214c tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:19.013295 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c5561595-8c27-4282-bfcf-58ef3a12214c tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:19.014190 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c5561595-8c27-4282-bfcf-58ef3a12214c tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:19.014682 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c5561595-8c27-4282-bfcf-58ef3a12214c tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:19.166315 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-c5561595-8c27-4282-bfcf-58ef3a12214c tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:19.174979 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-c5561595-8c27-4282-bfcf-58ef3a12214c tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1594 microversion: 2.1 time: 0.173109 Feb 15 14:28:19.175557 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 294/595] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:19 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1594 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:19.255394 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-6c794e5c-14e3-4848-af19-c88a875d0b26 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:19.256204 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-6c794e5c-14e3-4848-af19-c88a875d0b26 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:19.262364 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6c794e5c-14e3-4848-af19-c88a875d0b26 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:19.262818 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6c794e5c-14e3-4848-af19-c88a875d0b26 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:19.263605 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6c794e5c-14e3-4848-af19-c88a875d0b26 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:19.264121 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6c794e5c-14e3-4848-af19-c88a875d0b26 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:19.267072 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-00aa55cb-5187-439f-b677-74ddad020e93 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:19.268290 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-00aa55cb-5187-439f-b677-74ddad020e93 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:19.275765 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-00aa55cb-5187-439f-b677-74ddad020e93 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:19.276694 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-00aa55cb-5187-439f-b677-74ddad020e93 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:19.278426 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-00aa55cb-5187-439f-b677-74ddad020e93 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:19.279414 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-00aa55cb-5187-439f-b677-74ddad020e93 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:19.310278 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-00aa55cb-5187-439f-b677-74ddad020e93 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046714 Feb 15 14:28:19.315087 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 295/596] 10.222.0.83 () {58 vars in 1301 bytes} [Tue Feb 15 14:28:19 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:28:19.408597 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-6c794e5c-14e3-4848-af19-c88a875d0b26 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:19.417428 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-6c794e5c-14e3-4848-af19-c88a875d0b26 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:19.418918 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-6c794e5c-14e3-4848-af19-c88a875d0b26 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:19.420065 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-6c794e5c-14e3-4848-af19-c88a875d0b26 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1807 microversion: 2.20 time: 0.169599 Feb 15 14:28:19.420668 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 302/597] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:28:19 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:28:20.323371 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-0c280fbb-06ad-4ed1-9c67-ed327c80edc8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:20.325017 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-0c280fbb-06ad-4ed1-9c67-ed327c80edc8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:20.334032 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0c280fbb-06ad-4ed1-9c67-ed327c80edc8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:20.334826 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0c280fbb-06ad-4ed1-9c67-ed327c80edc8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:20.335941 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0c280fbb-06ad-4ed1-9c67-ed327c80edc8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:20.336637 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0c280fbb-06ad-4ed1-9c67-ed327c80edc8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:20.368119 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-0c280fbb-06ad-4ed1-9c67-ed327c80edc8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048398 Feb 15 14:28:20.375603 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 296/598] 10.222.0.83 () {58 vars in 1301 bytes} [Tue Feb 15 14:28:20 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 14:28:20.446807 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-d0ac8f39-dc94-4761-96c0-0c2066437a82 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:20.447300 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-d0ac8f39-dc94-4761-96c0-0c2066437a82 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:20.453723 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d0ac8f39-dc94-4761-96c0-0c2066437a82 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:20.454431 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d0ac8f39-dc94-4761-96c0-0c2066437a82 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:20.455508 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d0ac8f39-dc94-4761-96c0-0c2066437a82 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:20.455946 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d0ac8f39-dc94-4761-96c0-0c2066437a82 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:20.638614 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-d0ac8f39-dc94-4761-96c0-0c2066437a82 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:20.649390 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-d0ac8f39-dc94-4761-96c0-0c2066437a82 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:20.650894 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-d0ac8f39-dc94-4761-96c0-0c2066437a82 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:20.652100 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-d0ac8f39-dc94-4761-96c0-0c2066437a82 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1807 microversion: 2.20 time: 0.213580 Feb 15 14:28:20.652698 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 303/599] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:28:20 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:28:21.472887 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-3f76f609-7b13-4304-9865-4a098f3e052d req-788bd37a-b2bb-401e-a700-450c0d8c566b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e14d18-ad60-48d1-8a93-b30daacb8ce7", "tag": "2628aace-ae5c-4b38-940c-d120d41232de"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:28:21.474588 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:28:21.474588 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:28:21.483637 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-3f76f609-7b13-4304-9865-4a098f3e052d req-788bd37a-b2bb-401e-a700-450c0d8c566b service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:21.484215 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-3f76f609-7b13-4304-9865-4a098f3e052d req-788bd37a-b2bb-401e-a700-450c0d8c566b service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:21.501801 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-3f76f609-7b13-4304-9865-4a098f3e052d req-788bd37a-b2bb-401e-a700-450c0d8c566b service nova] Creating event network-changed:2628aace-ae5c-4b38-940c-d120d41232de for instance e5e14d18-ad60-48d1-8a93-b30daacb8ce7 on hv-cinder-81914 Feb 15 14:28:21.508883 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-3f76f609-7b13-4304-9865-4a098f3e052d req-788bd37a-b2bb-401e-a700-450c0d8c566b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039754 Feb 15 14:28:21.509793 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 297/600] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:28:21.674809 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-b41b1e19-f3b3-43d8-bea1-2b205a816ca8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:21.677838 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-b41b1e19-f3b3-43d8-bea1-2b205a816ca8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:21.690034 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b41b1e19-f3b3-43d8-bea1-2b205a816ca8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:21.690797 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b41b1e19-f3b3-43d8-bea1-2b205a816ca8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:21.693828 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b41b1e19-f3b3-43d8-bea1-2b205a816ca8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:21.694893 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b41b1e19-f3b3-43d8-bea1-2b205a816ca8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:22.028955 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-b41b1e19-f3b3-43d8-bea1-2b205a816ca8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:22.044308 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-b41b1e19-f3b3-43d8-bea1-2b205a816ca8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:22.048004 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-b41b1e19-f3b3-43d8-bea1-2b205a816ca8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:22.051302 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-b41b1e19-f3b3-43d8-bea1-2b205a816ca8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1807 microversion: 2.20 time: 0.383076 Feb 15 14:28:22.054433 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 304/601] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:28:21 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1807 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:28:22.857824 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-26ae7df1-b49f-4c3d-ab1d-064bb9d20ffa tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:22.858489 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-74cfaa4c-fc85-4e28-9c56-8d2f3575f973 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-512324652"}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:28:22.858874 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-74cfaa4c-fc85-4e28-9c56-8d2f3575f973 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:22.859541 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-26ae7df1-b49f-4c3d-ab1d-064bb9d20ffa tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:22.866963 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-74cfaa4c-fc85-4e28-9c56-8d2f3575f973 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:22.867431 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-26ae7df1-b49f-4c3d-ab1d-064bb9d20ffa tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:22.867577 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-74cfaa4c-fc85-4e28-9c56-8d2f3575f973 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:22.868171 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-26ae7df1-b49f-4c3d-ab1d-064bb9d20ffa tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:22.868538 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-74cfaa4c-fc85-4e28-9c56-8d2f3575f973 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:22.868974 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-74cfaa4c-fc85-4e28-9c56-8d2f3575f973 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:22.869442 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-26ae7df1-b49f-4c3d-ab1d-064bb9d20ffa tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:22.870024 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-26ae7df1-b49f-4c3d-ab1d-064bb9d20ffa tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:22.911888 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-26ae7df1-b49f-4c3d-ab1d-064bb9d20ffa tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Going to try to terminate instance {{(pid=116363) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 14:28:23.006798 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-26ae7df1-b49f-4c3d-ab1d-064bb9d20ffa tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "DELETE /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 204 len: 0 microversion: 2.1 time: 0.152068 Feb 15 14:28:23.008024 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 305/602] 10.222.0.83 () {58 vars in 1238 bytes} [Tue Feb 15 14:28:22 2022] DELETE /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 15 14:28:23.017792 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-fb6c2860-e597-4e2d-9f32-5e71c998205a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:23.018944 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-fb6c2860-e597-4e2d-9f32-5e71c998205a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:23.030585 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-fb6c2860-e597-4e2d-9f32-5e71c998205a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:23.031729 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-fb6c2860-e597-4e2d-9f32-5e71c998205a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:23.033188 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-fb6c2860-e597-4e2d-9f32-5e71c998205a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:23.033933 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-fb6c2860-e597-4e2d-9f32-5e71c998205a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:23.071171 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.network.security_group_api [None req-74cfaa4c-fc85-4e28-9c56-8d2f3575f973 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Adding security group 11b02767-e3f1-427f-b295-b415de9ae61b to port 2628aace-ae5c-4b38-940c-d120d41232de Feb 15 14:28:23.271319 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-fb6c2860-e597-4e2d-9f32-5e71c998205a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:23.284235 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-fb6c2860-e597-4e2d-9f32-5e71c998205a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1507 microversion: 2.1 time: 0.271514 Feb 15 14:28:23.286629 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 306/603] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:23 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1507 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:23.293200 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-29ee8aea-e857-4fb3-ac4f-1541267eda55 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:23.294230 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-29ee8aea-e857-4fb3-ac4f-1541267eda55 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:23.301288 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-29ee8aea-e857-4fb3-ac4f-1541267eda55 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:23.302130 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-29ee8aea-e857-4fb3-ac4f-1541267eda55 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:23.302975 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-29ee8aea-e857-4fb3-ac4f-1541267eda55 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:23.303395 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-29ee8aea-e857-4fb3-ac4f-1541267eda55 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:23.485224 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-74cfaa4c-fc85-4e28-9c56-8d2f3575f973 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "POST /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7/action" status: 202 len: 0 microversion: 2.1 time: 0.631215 Feb 15 14:28:23.485838 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 298/604] 10.222.0.83 () {60 vars in 1277 bytes} [Tue Feb 15 14:28:22 2022] POST /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:28:23.493883 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-fa8e3fc3-7f02-4f31-947e-436be079c1dd tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:23.494496 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-fa8e3fc3-7f02-4f31-947e-436be079c1dd tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:23.503102 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fa8e3fc3-7f02-4f31-947e-436be079c1dd tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:23.503554 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fa8e3fc3-7f02-4f31-947e-436be079c1dd tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:23.508225 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fa8e3fc3-7f02-4f31-947e-436be079c1dd tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:23.508717 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fa8e3fc3-7f02-4f31-947e-436be079c1dd tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:23.522780 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-29ee8aea-e857-4fb3-ac4f-1541267eda55 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:23.534003 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-29ee8aea-e857-4fb3-ac4f-1541267eda55 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:23.540311 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-29ee8aea-e857-4fb3-ac4f-1541267eda55 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:23.541560 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-29ee8aea-e857-4fb3-ac4f-1541267eda55 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1794 microversion: 2.20 time: 0.252682 Feb 15 14:28:23.542876 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 307/605] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:28:23 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1794 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:28:23.556142 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-38a843e8-c2a7-461a-af63-f6eb09c4272a req-0459134d-1ecb-49be-863a-b17ef56a6b6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e14d18-ad60-48d1-8a93-b30daacb8ce7", "tag": "2628aace-ae5c-4b38-940c-d120d41232de"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:28:23.558085 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:28:23.558085 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:28:23.574508 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-38a843e8-c2a7-461a-af63-f6eb09c4272a req-0459134d-1ecb-49be-863a-b17ef56a6b6e service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:23.575245 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-38a843e8-c2a7-461a-af63-f6eb09c4272a req-0459134d-1ecb-49be-863a-b17ef56a6b6e service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:23.595265 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-38a843e8-c2a7-461a-af63-f6eb09c4272a req-0459134d-1ecb-49be-863a-b17ef56a6b6e service nova] Creating event network-changed:2628aace-ae5c-4b38-940c-d120d41232de for instance e5e14d18-ad60-48d1-8a93-b30daacb8ce7 on hv-cinder-81914 Feb 15 14:28:23.601953 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-38a843e8-c2a7-461a-af63-f6eb09c4272a req-0459134d-1ecb-49be-863a-b17ef56a6b6e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057497 Feb 15 14:28:23.603047 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 308/606] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:28:23.850285 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-fa8e3fc3-7f02-4f31-947e-436be079c1dd tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:23.860942 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-fa8e3fc3-7f02-4f31-947e-436be079c1dd tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1759 microversion: 2.1 time: 0.370391 Feb 15 14:28:23.862676 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 299/607] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:23 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1759 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:28:24.303358 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-c617e005-5777-4c65-aa6e-156fc3baa008 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:24.304060 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-c617e005-5777-4c65-aa6e-156fc3baa008 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:24.310009 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c617e005-5777-4c65-aa6e-156fc3baa008 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:24.310458 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c617e005-5777-4c65-aa6e-156fc3baa008 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:24.311463 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c617e005-5777-4c65-aa6e-156fc3baa008 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:24.311965 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c617e005-5777-4c65-aa6e-156fc3baa008 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:24.446180 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-c617e005-5777-4c65-aa6e-156fc3baa008 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:24.453751 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-c617e005-5777-4c65-aa6e-156fc3baa008 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1507 microversion: 2.1 time: 0.155073 Feb 15 14:28:24.454340 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 309/608] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:24 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:25.470499 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-48a319a5-d36b-436a-b8d3-9c9c231f4dc5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:25.471108 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-48a319a5-d36b-436a-b8d3-9c9c231f4dc5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:25.477530 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-48a319a5-d36b-436a-b8d3-9c9c231f4dc5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:25.477976 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-48a319a5-d36b-436a-b8d3-9c9c231f4dc5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:25.478740 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-48a319a5-d36b-436a-b8d3-9c9c231f4dc5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:25.479174 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-48a319a5-d36b-436a-b8d3-9c9c231f4dc5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:25.614244 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-48a319a5-d36b-436a-b8d3-9c9c231f4dc5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:25.621590 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-48a319a5-d36b-436a-b8d3-9c9c231f4dc5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1507 microversion: 2.1 time: 0.154834 Feb 15 14:28:25.622181 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 300/609] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:25 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:26.638753 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-0f640fe8-9744-44b6-8ef4-1697a3a0839c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:26.639383 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-0f640fe8-9744-44b6-8ef4-1697a3a0839c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:26.647276 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0f640fe8-9744-44b6-8ef4-1697a3a0839c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:26.647723 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0f640fe8-9744-44b6-8ef4-1697a3a0839c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:26.648539 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0f640fe8-9744-44b6-8ef4-1697a3a0839c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:26.648974 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0f640fe8-9744-44b6-8ef4-1697a3a0839c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:26.783638 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-0f640fe8-9744-44b6-8ef4-1697a3a0839c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:26.791750 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-0f640fe8-9744-44b6-8ef4-1697a3a0839c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1507 microversion: 2.1 time: 0.156651 Feb 15 14:28:26.792318 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 310/610] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:26 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:27.508578 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-05edb23b-3fa8-48ab-afde-ce876c0d9f5c req-647170f2-b930-48ff-a640-1e037c2c60ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da335cfa-e017-4c76-b734-1aa9f65add13", "name": "network-vif-deleted", "tag": "9aa04bc6-dbe4-47a7-b359-c0906fd2d893"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:28:27.510255 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:28:27.510255 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:28:27.517682 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-05edb23b-3fa8-48ab-afde-ce876c0d9f5c req-647170f2-b930-48ff-a640-1e037c2c60ad service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:27.518118 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-05edb23b-3fa8-48ab-afde-ce876c0d9f5c req-647170f2-b930-48ff-a640-1e037c2c60ad service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:27.529300 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-05edb23b-3fa8-48ab-afde-ce876c0d9f5c req-647170f2-b930-48ff-a640-1e037c2c60ad service nova] Creating event network-vif-deleted:9aa04bc6-dbe4-47a7-b359-c0906fd2d893 for instance da335cfa-e017-4c76-b734-1aa9f65add13 on hv-cinder-81914 Feb 15 14:28:27.535140 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-05edb23b-3fa8-48ab-afde-ce876c0d9f5c req-647170f2-b930-48ff-a640-1e037c2c60ad service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030730 Feb 15 14:28:27.536705 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 301/611] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:28:27.810050 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-008e5bd0-e616-42f1-8f5a-2dced7b5ab1a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:27.810851 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-008e5bd0-e616-42f1-8f5a-2dced7b5ab1a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:27.817140 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-008e5bd0-e616-42f1-8f5a-2dced7b5ab1a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:27.817582 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-008e5bd0-e616-42f1-8f5a-2dced7b5ab1a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:27.818353 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-008e5bd0-e616-42f1-8f5a-2dced7b5ab1a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:27.818787 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-008e5bd0-e616-42f1-8f5a-2dced7b5ab1a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:27.850834 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-008e5bd0-e616-42f1-8f5a-2dced7b5ab1a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:27.851284 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-008e5bd0-e616-42f1-8f5a-2dced7b5ab1a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:27.851751 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.objects.instance [None req-008e5bd0-e616-42f1-8f5a-2dced7b5ab1a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lazy-loading 'fault' on Instance uuid da335cfa-e017-4c76-b734-1aa9f65add13 {{(pid=116363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:28:27.898274 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-008e5bd0-e616-42f1-8f5a-2dced7b5ab1a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:27.906170 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-008e5bd0-e616-42f1-8f5a-2dced7b5ab1a tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 200 len: 1312 microversion: 2.1 time: 0.100509 Feb 15 14:28:27.906752 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 311/612] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:27 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:28.923552 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-dd6891d5-3bdf-4455-9e05-bde6c52fb2ab tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:28.924252 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-dd6891d5-3bdf-4455-9e05-bde6c52fb2ab tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: da335cfa-e017-4c76-b734-1aa9f65add13] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:28.930958 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-dd6891d5-3bdf-4455-9e05-bde6c52fb2ab tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:28.931403 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-dd6891d5-3bdf-4455-9e05-bde6c52fb2ab tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:28.932198 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-dd6891d5-3bdf-4455-9e05-bde6c52fb2ab tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:28.932655 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-dd6891d5-3bdf-4455-9e05-bde6c52fb2ab tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:28.946007 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.wsgi [None req-dd6891d5-3bdf-4455-9e05-bde6c52fb2ab tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] HTTP exception thrown: Instance da335cfa-e017-4c76-b734-1aa9f65add13 could not be found. Feb 15 14:28:28.946592 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-dd6891d5-3bdf-4455-9e05-bde6c52fb2ab tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Returning 404 to user: Instance da335cfa-e017-4c76-b734-1aa9f65add13 could not be found. {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:28:28.947409 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-dd6891d5-3bdf-4455-9e05-bde6c52fb2ab tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13" status: 404 len: 111 microversion: 2.1 time: 0.028291 Feb 15 14:28:28.947935 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 302/613] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:28 2022] GET /compute/v2.1/servers/da335cfa-e017-4c76-b734-1aa9f65add13 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:28:28.955504 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-b97135d4-a00d-4751-a30f-4427b6dfa03c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:28.955976 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-b97135d4-a00d-4751-a30f-4427b6dfa03c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:28.962459 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b97135d4-a00d-4751-a30f-4427b6dfa03c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:28.962900 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b97135d4-a00d-4751-a30f-4427b6dfa03c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:28.963658 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b97135d4-a00d-4751-a30f-4427b6dfa03c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:28.964086 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b97135d4-a00d-4751-a30f-4427b6dfa03c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:28.988511 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-b97135d4-a00d-4751-a30f-4427b6dfa03c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Going to try to terminate instance {{(pid=116363) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 14:28:29.060181 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-b97135d4-a00d-4751-a30f-4427b6dfa03c tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "DELETE /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 204 len: 0 microversion: 2.1 time: 0.108019 Feb 15 14:28:29.060777 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 312/614] 10.222.0.83 () {58 vars in 1238 bytes} [Tue Feb 15 14:28:28 2022] DELETE /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 14:28:29.069284 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-95d5c2f9-ef69-40cf-a67c-b4418f1a1962 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:29.070017 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-95d5c2f9-ef69-40cf-a67c-b4418f1a1962 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:29.076858 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-95d5c2f9-ef69-40cf-a67c-b4418f1a1962 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:29.077391 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-95d5c2f9-ef69-40cf-a67c-b4418f1a1962 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:29.078174 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-95d5c2f9-ef69-40cf-a67c-b4418f1a1962 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:29.078611 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-95d5c2f9-ef69-40cf-a67c-b4418f1a1962 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:29.218111 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-95d5c2f9-ef69-40cf-a67c-b4418f1a1962 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:29.225531 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-95d5c2f9-ef69-40cf-a67c-b4418f1a1962 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.160710 Feb 15 14:28:29.226092 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 303/615] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:29 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:28:30.243661 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-79262fbd-5b03-43ce-a89b-31125228e197 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:30.244362 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-79262fbd-5b03-43ce-a89b-31125228e197 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:30.250626 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-79262fbd-5b03-43ce-a89b-31125228e197 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:30.251075 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-79262fbd-5b03-43ce-a89b-31125228e197 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:30.251843 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-79262fbd-5b03-43ce-a89b-31125228e197 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:30.252278 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-79262fbd-5b03-43ce-a89b-31125228e197 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:30.386040 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-79262fbd-5b03-43ce-a89b-31125228e197 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:30.393309 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-79262fbd-5b03-43ce-a89b-31125228e197 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.153696 Feb 15 14:28:30.393873 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 313/616] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:30 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:31.410359 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-010fb31c-8b45-43ad-8285-42eebfa15f03 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:31.411127 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-010fb31c-8b45-43ad-8285-42eebfa15f03 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:31.417520 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-010fb31c-8b45-43ad-8285-42eebfa15f03 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:31.417974 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-010fb31c-8b45-43ad-8285-42eebfa15f03 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:31.418750 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-010fb31c-8b45-43ad-8285-42eebfa15f03 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:31.419190 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-010fb31c-8b45-43ad-8285-42eebfa15f03 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:31.550275 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-010fb31c-8b45-43ad-8285-42eebfa15f03 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:31.557796 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-010fb31c-8b45-43ad-8285-42eebfa15f03 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.151076 Feb 15 14:28:31.558357 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 304/617] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:31 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:32.575266 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-ab5c008e-9816-45df-a25d-21c5f98de9e8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:32.575870 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-ab5c008e-9816-45df-a25d-21c5f98de9e8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:32.582192 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ab5c008e-9816-45df-a25d-21c5f98de9e8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:32.583266 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ab5c008e-9816-45df-a25d-21c5f98de9e8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:32.584115 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ab5c008e-9816-45df-a25d-21c5f98de9e8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:32.584579 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ab5c008e-9816-45df-a25d-21c5f98de9e8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:32.714502 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-ab5c008e-9816-45df-a25d-21c5f98de9e8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:32.721747 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-ab5c008e-9816-45df-a25d-21c5f98de9e8 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.150134 Feb 15 14:28:32.722496 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 314/618] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:32 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:33.738384 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-29fc6e7f-a7fa-414a-b91f-f6b50e175ba2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:33.738994 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-29fc6e7f-a7fa-414a-b91f-f6b50e175ba2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:33.745216 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-29fc6e7f-a7fa-414a-b91f-f6b50e175ba2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:33.745667 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-29fc6e7f-a7fa-414a-b91f-f6b50e175ba2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:33.746440 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-29fc6e7f-a7fa-414a-b91f-f6b50e175ba2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:33.746875 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-29fc6e7f-a7fa-414a-b91f-f6b50e175ba2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:33.875565 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-29fc6e7f-a7fa-414a-b91f-f6b50e175ba2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:33.883633 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-29fc6e7f-a7fa-414a-b91f-f6b50e175ba2 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.148884 Feb 15 14:28:33.884208 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 305/619] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:33 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:34.900171 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-e86ceb02-3fe8-458d-bc17-0bf6d0779f49 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:34.902406 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-e86ceb02-3fe8-458d-bc17-0bf6d0779f49 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:34.907251 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e86ceb02-3fe8-458d-bc17-0bf6d0779f49 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:34.907691 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e86ceb02-3fe8-458d-bc17-0bf6d0779f49 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:34.908489 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e86ceb02-3fe8-458d-bc17-0bf6d0779f49 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:34.908921 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e86ceb02-3fe8-458d-bc17-0bf6d0779f49 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:35.047529 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-e86ceb02-3fe8-458d-bc17-0bf6d0779f49 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:35.055443 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-e86ceb02-3fe8-458d-bc17-0bf6d0779f49 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.159258 Feb 15 14:28:35.056011 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 315/620] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:34 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:36.072493 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-42290bdb-32c3-47de-8c6e-9875b4be731f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:36.073108 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-42290bdb-32c3-47de-8c6e-9875b4be731f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:36.079311 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-42290bdb-32c3-47de-8c6e-9875b4be731f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:36.079764 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-42290bdb-32c3-47de-8c6e-9875b4be731f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:36.080596 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-42290bdb-32c3-47de-8c6e-9875b4be731f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:36.081038 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-42290bdb-32c3-47de-8c6e-9875b4be731f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:36.218978 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-42290bdb-32c3-47de-8c6e-9875b4be731f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:36.227302 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-42290bdb-32c3-47de-8c6e-9875b4be731f tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.158336 Feb 15 14:28:36.228002 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 306/621] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:36 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:37.244332 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-3da9946d-0531-454a-b4ba-dd95480318f5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:37.244896 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-3da9946d-0531-454a-b4ba-dd95480318f5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:37.251344 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3da9946d-0531-454a-b4ba-dd95480318f5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:37.251793 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3da9946d-0531-454a-b4ba-dd95480318f5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:37.252612 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3da9946d-0531-454a-b4ba-dd95480318f5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:37.253048 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3da9946d-0531-454a-b4ba-dd95480318f5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:37.385568 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-3da9946d-0531-454a-b4ba-dd95480318f5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:37.392830 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-3da9946d-0531-454a-b4ba-dd95480318f5 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1521 microversion: 2.1 time: 0.152204 Feb 15 14:28:37.393483 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 316/622] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:37 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:38.041887 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-8d286bd0-1be4-4fca-bb48-6bf922461ba7 req-68b796ae-d2c4-482b-b50d-7e9b34d16230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13edf4fd-20da-43ce-bb58-5757dc0f96c7", "name": "network-vif-deleted", "tag": "09e7ae20-efee-4ba4-bc83-98bd05f41729"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:28:38.043397 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:28:38.043397 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:28:38.051353 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-8d286bd0-1be4-4fca-bb48-6bf922461ba7 req-68b796ae-d2c4-482b-b50d-7e9b34d16230 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:38.052010 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-8d286bd0-1be4-4fca-bb48-6bf922461ba7 req-68b796ae-d2c4-482b-b50d-7e9b34d16230 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:38.062640 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-8d286bd0-1be4-4fca-bb48-6bf922461ba7 req-68b796ae-d2c4-482b-b50d-7e9b34d16230 service nova] Creating event network-vif-deleted:09e7ae20-efee-4ba4-bc83-98bd05f41729 for instance 13edf4fd-20da-43ce-bb58-5757dc0f96c7 on hv-cinder-81914 Feb 15 14:28:38.067750 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-8d286bd0-1be4-4fca-bb48-6bf922461ba7 req-68b796ae-d2c4-482b-b50d-7e9b34d16230 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029437 Feb 15 14:28:38.068270 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 307/623] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:28:38.411053 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-821f1088-32c1-4a81-9b6a-f9d3a77e7ed4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:38.411657 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-821f1088-32c1-4a81-9b6a-f9d3a77e7ed4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:38.418007 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-821f1088-32c1-4a81-9b6a-f9d3a77e7ed4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:38.418449 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-821f1088-32c1-4a81-9b6a-f9d3a77e7ed4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:38.419208 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-821f1088-32c1-4a81-9b6a-f9d3a77e7ed4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:38.419751 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-821f1088-32c1-4a81-9b6a-f9d3a77e7ed4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:38.482825 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-821f1088-32c1-4a81-9b6a-f9d3a77e7ed4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:38.490656 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-821f1088-32c1-4a81-9b6a-f9d3a77e7ed4 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1479 microversion: 2.1 time: 0.083332 Feb 15 14:28:38.491226 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 317/624] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:38 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1479 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:39.508355 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-b4799e52-e7ce-43d4-be6d-62c2bfdb2106 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:39.509080 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-b4799e52-e7ce-43d4-be6d-62c2bfdb2106 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:39.515152 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b4799e52-e7ce-43d4-be6d-62c2bfdb2106 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:39.515603 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b4799e52-e7ce-43d4-be6d-62c2bfdb2106 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:39.516374 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b4799e52-e7ce-43d4-be6d-62c2bfdb2106 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:39.516836 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b4799e52-e7ce-43d4-be6d-62c2bfdb2106 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:39.580383 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-b4799e52-e7ce-43d4-be6d-62c2bfdb2106 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:39.587964 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-b4799e52-e7ce-43d4-be6d-62c2bfdb2106 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1307 microversion: 2.1 time: 0.084661 Feb 15 14:28:39.588724 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 308/625] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:39 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1307 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:40.604555 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-9341316e-f542-477f-915b-020e0fe124a0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:40.605502 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-9341316e-f542-477f-915b-020e0fe124a0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:40.611404 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9341316e-f542-477f-915b-020e0fe124a0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:40.611858 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9341316e-f542-477f-915b-020e0fe124a0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:40.612668 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9341316e-f542-477f-915b-020e0fe124a0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:40.613840 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9341316e-f542-477f-915b-020e0fe124a0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:40.646102 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9341316e-f542-477f-915b-020e0fe124a0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:40.646553 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9341316e-f542-477f-915b-020e0fe124a0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:40.647003 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.objects.instance [None req-9341316e-f542-477f-915b-020e0fe124a0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lazy-loading 'fault' on Instance uuid 13edf4fd-20da-43ce-bb58-5757dc0f96c7 {{(pid=116363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:28:40.689687 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-9341316e-f542-477f-915b-020e0fe124a0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00597b65c3a345e29a6f6db64db1a2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4079ad6434da4f068459b1ce313f662d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:40.697133 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-9341316e-f542-477f-915b-020e0fe124a0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 200 len: 1312 microversion: 2.1 time: 0.096518 Feb 15 14:28:40.697732 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 318/626] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:40 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:28:41.713518 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-82ceeed1-10ce-4f0b-bb02-00c84e9362b0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:41.714132 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-82ceeed1-10ce-4f0b-bb02-00c84e9362b0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] [instance: 13edf4fd-20da-43ce-bb58-5757dc0f96c7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:41.722098 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-82ceeed1-10ce-4f0b-bb02-00c84e9362b0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:41.722670 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-82ceeed1-10ce-4f0b-bb02-00c84e9362b0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:41.723454 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-82ceeed1-10ce-4f0b-bb02-00c84e9362b0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:41.723899 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-82ceeed1-10ce-4f0b-bb02-00c84e9362b0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:41.737157 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.wsgi [None req-82ceeed1-10ce-4f0b-bb02-00c84e9362b0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] HTTP exception thrown: Instance 13edf4fd-20da-43ce-bb58-5757dc0f96c7 could not be found. Feb 15 14:28:41.737745 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-82ceeed1-10ce-4f0b-bb02-00c84e9362b0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] Returning 404 to user: Instance 13edf4fd-20da-43ce-bb58-5757dc0f96c7 could not be found. {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:28:41.739092 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-82ceeed1-10ce-4f0b-bb02-00c84e9362b0 tempest-ServerRescueNegativeTestJSON-951811350 tempest-ServerRescueNegativeTestJSON-951811350-project] 10.222.0.83 "GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7" status: 404 len: 111 microversion: 2.1 time: 0.029178 Feb 15 14:28:41.742986 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 309/627] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:41 2022] GET /compute/v2.1/servers/13edf4fd-20da-43ce-bb58-5757dc0f96c7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:28:50.637805 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-4f7df3ed-75eb-4c18-91ed-b2524bf6dc72 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Action: 'create', calling method: .version_select at 0x7fd74f51c280>, body: {"keypair": {"name": "tempest-keypair-818690589"}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:28:50.666200 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-4f7df3ed-75eb-4c18-91ed-b2524bf6dc72 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Getting quotas for project daa71715dd644b259ad6713b99c6a3d4. Resources: {'key_pairs'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:28:50.671091 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-4f7df3ed-75eb-4c18-91ed-b2524bf6dc72 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Getting quotas for user c9f121c2569f456ba0f2374744491315 and project daa71715dd644b259ad6713b99c6a3d4. Resources: {'key_pairs'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:28:50.901267 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-4f7df3ed-75eb-4c18-91ed-b2524bf6dc72 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Getting quotas for project daa71715dd644b259ad6713b99c6a3d4. Resources: {'key_pairs'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:28:50.906024 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-4f7df3ed-75eb-4c18-91ed-b2524bf6dc72 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Getting quotas for user c9f121c2569f456ba0f2374744491315 and project daa71715dd644b259ad6713b99c6a3d4. Resources: {'key_pairs'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:28:50.921103 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-4f7df3ed-75eb-4c18-91ed-b2524bf6dc72 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.424961 Feb 15 14:28:50.921738 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 319/628] 10.222.0.83 () {60 vars in 1157 bytes} [Tue Feb 15 14:28:50 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:52.408775 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-ecc396aa-ba6a-4f24-a672-5b451d2eb715 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1012886438", "imageRef": "da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fef2f674-f393-4182-96e5-05e9c8ae5530"}], "security_groups": [{"name": "tempest-securitygroup--307027049"}], "key_name": "tempest-keypair-818690589", "user_data": "}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:28:52.552917 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.network.neutron [None req-ecc396aa-ba6a-4f24-a672-5b451d2eb715 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] validate_networks() for [('fef2f674-f393-4182-96e5-05e9c8ae5530', None, None, None, None, None)] {{(pid=116362) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 14:28:52.961889 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-ecc396aa-ba6a-4f24-a672-5b451d2eb715 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Flavor limits 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 14:28:52.962395 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-ecc396aa-ba6a-4f24-a672-5b451d2eb715 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Image limits 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 14:28:52.962866 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-ecc396aa-ba6a-4f24-a672-5b451d2eb715 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Flavor pref 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 14:28:52.963269 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-ecc396aa-ba6a-4f24-a672-5b451d2eb715 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Image pref 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 14:28:52.963724 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-ecc396aa-ba6a-4f24-a672-5b451d2eb715 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 14:28:52.973922 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ecc396aa-ba6a-4f24-a672-5b451d2eb715 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:52.974542 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ecc396aa-ba6a-4f24-a672-5b451d2eb715 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:52.975790 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ecc396aa-ba6a-4f24-a672-5b451d2eb715 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:52.975790 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ecc396aa-ba6a-4f24-a672-5b451d2eb715 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:52.996201 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-ecc396aa-ba6a-4f24-a672-5b451d2eb715 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Getting quotas for project daa71715dd644b259ad6713b99c6a3d4. Resources: {'instances', 'ram', 'cores'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:28:53.000247 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-ecc396aa-ba6a-4f24-a672-5b451d2eb715 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Getting quotas for user c9f121c2569f456ba0f2374744491315 and project daa71715dd644b259ad6713b99c6a3d4. Resources: {'instances', 'ram', 'cores'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:28:53.012968 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-ecc396aa-ba6a-4f24-a672-5b451d2eb715 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Going to run 1 instances... {{(pid=116362) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 14:28:53.015715 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-ecc396aa-ba6a-4f24-a672-5b451d2eb715 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 14:28:53.069008 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-ecc396aa-ba6a-4f24-a672-5b451d2eb715 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.677373 Feb 15 14:28:53.081666 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-0ba2c50a-4403-4b2c-81fa-532bb2b194e0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:53.082320 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-0ba2c50a-4403-4b2c-81fa-532bb2b194e0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:53.090384 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 310/629] 10.222.0.83 () {60 vars in 1146 bytes} [Tue Feb 15 14:28:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 14:28:53.140652 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-0ba2c50a-4403-4b2c-81fa-532bb2b194e0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:53.149239 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-0ba2c50a-4403-4b2c-81fa-532bb2b194e0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1237 microversion: 2.1 time: 0.073578 Feb 15 14:28:53.169747 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 320/630] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:53 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1237 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:28:54.166948 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-b3db80f7-e4ef-4913-b06e-2f73b2208c21 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:54.169238 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-b3db80f7-e4ef-4913-b06e-2f73b2208c21 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:54.176789 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b3db80f7-e4ef-4913-b06e-2f73b2208c21 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:54.182190 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b3db80f7-e4ef-4913-b06e-2f73b2208c21 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:54.183260 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b3db80f7-e4ef-4913-b06e-2f73b2208c21 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:54.183877 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b3db80f7-e4ef-4913-b06e-2f73b2208c21 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:54.288377 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-b3db80f7-e4ef-4913-b06e-2f73b2208c21 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:54.298166 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-b3db80f7-e4ef-4913-b06e-2f73b2208c21 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1289 microversion: 2.1 time: 0.135389 Feb 15 14:28:54.309194 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 311/631] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:54 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1289 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:55.316586 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-cedc90d3-cb14-411f-8d15-378f0e0f4605 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:55.317197 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-cedc90d3-cb14-411f-8d15-378f0e0f4605 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:55.323375 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-cedc90d3-cb14-411f-8d15-378f0e0f4605 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:55.323824 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-cedc90d3-cb14-411f-8d15-378f0e0f4605 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:55.324674 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-cedc90d3-cb14-411f-8d15-378f0e0f4605 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:55.325148 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-cedc90d3-cb14-411f-8d15-378f0e0f4605 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:55.461817 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-cedc90d3-cb14-411f-8d15-378f0e0f4605 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:55.468989 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-cedc90d3-cb14-411f-8d15-378f0e0f4605 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1362 microversion: 2.1 time: 0.156094 Feb 15 14:28:55.469560 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 321/632] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:55 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:55.840453 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-ee8c4de1-6515-40ed-b7d0-7f298f3678a0 req-8b938ce6-6496-4308-a7de-4bafa5271708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db561480-36d5-4879-aa89-d62bf3623851", "tag": "012c5a46-cbe3-4127-98c8-54961f7dbe01"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:28:55.843113 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:28:55.843113 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:28:55.851766 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-ee8c4de1-6515-40ed-b7d0-7f298f3678a0 req-8b938ce6-6496-4308-a7de-4bafa5271708 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:55.852585 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-ee8c4de1-6515-40ed-b7d0-7f298f3678a0 req-8b938ce6-6496-4308-a7de-4bafa5271708 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:55.863716 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-ee8c4de1-6515-40ed-b7d0-7f298f3678a0 req-8b938ce6-6496-4308-a7de-4bafa5271708 service nova] Creating event network-changed:012c5a46-cbe3-4127-98c8-54961f7dbe01 for instance db561480-36d5-4879-aa89-d62bf3623851 on hv-cinder-81914 Feb 15 14:28:55.873907 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-ee8c4de1-6515-40ed-b7d0-7f298f3678a0 req-8b938ce6-6496-4308-a7de-4bafa5271708 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036985 Feb 15 14:28:55.874801 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 312/633] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:28:56.486510 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-d62d34d0-09a1-441f-a1ee-d76ec18428ff tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:56.487787 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-d62d34d0-09a1-441f-a1ee-d76ec18428ff tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:56.494066 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d62d34d0-09a1-441f-a1ee-d76ec18428ff tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:56.494508 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d62d34d0-09a1-441f-a1ee-d76ec18428ff tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:56.495279 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d62d34d0-09a1-441f-a1ee-d76ec18428ff tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:56.495707 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d62d34d0-09a1-441f-a1ee-d76ec18428ff tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:56.635288 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-d62d34d0-09a1-441f-a1ee-d76ec18428ff tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:56.642704 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-d62d34d0-09a1-441f-a1ee-d76ec18428ff tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1362 microversion: 2.1 time: 0.159780 Feb 15 14:28:56.643202 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 322/634] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:56 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:57.660165 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-29f5a820-920f-485d-bda7-d5a32bb826a8 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:57.660913 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-29f5a820-920f-485d-bda7-d5a32bb826a8 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:57.667012 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-29f5a820-920f-485d-bda7-d5a32bb826a8 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:57.667460 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-29f5a820-920f-485d-bda7-d5a32bb826a8 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:57.668229 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-29f5a820-920f-485d-bda7-d5a32bb826a8 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:57.668695 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-29f5a820-920f-485d-bda7-d5a32bb826a8 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:57.803478 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-29f5a820-920f-485d-bda7-d5a32bb826a8 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:57.811884 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-29f5a820-920f-485d-bda7-d5a32bb826a8 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1362 microversion: 2.1 time: 0.155472 Feb 15 14:28:57.812573 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 313/635] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:57 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:28:58.831215 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-722c9ef8-e90e-43c8-a1f8-3a0aa17dfa0a tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:28:58.831844 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-722c9ef8-e90e-43c8-a1f8-3a0aa17dfa0a tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:28:58.838412 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-722c9ef8-e90e-43c8-a1f8-3a0aa17dfa0a tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:58.838860 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-722c9ef8-e90e-43c8-a1f8-3a0aa17dfa0a tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:58.839687 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-722c9ef8-e90e-43c8-a1f8-3a0aa17dfa0a tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:28:58.840124 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-722c9ef8-e90e-43c8-a1f8-3a0aa17dfa0a tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:28:58.985878 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-722c9ef8-e90e-43c8-a1f8-3a0aa17dfa0a tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:28:58.995726 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-722c9ef8-e90e-43c8-a1f8-3a0aa17dfa0a tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1362 microversion: 2.1 time: 0.168772 Feb 15 14:28:58.996736 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 323/636] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:28:58 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:00.014201 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-aac3ddfe-3ee1-41bf-babe-1957a70bc9ca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:00.014816 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-aac3ddfe-3ee1-41bf-babe-1957a70bc9ca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:00.021975 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-aac3ddfe-3ee1-41bf-babe-1957a70bc9ca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:00.022747 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-aac3ddfe-3ee1-41bf-babe-1957a70bc9ca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:00.023689 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-aac3ddfe-3ee1-41bf-babe-1957a70bc9ca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:00.024242 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-aac3ddfe-3ee1-41bf-babe-1957a70bc9ca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:00.181006 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-aac3ddfe-3ee1-41bf-babe-1957a70bc9ca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:00.201261 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-aac3ddfe-3ee1-41bf-babe-1957a70bc9ca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1362 microversion: 2.1 time: 0.190603 Feb 15 14:29:00.201862 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 314/637] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:00 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:00.816853 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-df0ea648-9315-420d-a2a1-018be608153a req-e7a30c7b-0a20-4bff-85ad-55f490cf0161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db561480-36d5-4879-aa89-d62bf3623851", "name": "network-vif-plugged", "status": "completed", "tag": "012c5a46-cbe3-4127-98c8-54961f7dbe01"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:29:00.819102 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:29:00.819102 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:29:00.827856 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-df0ea648-9315-420d-a2a1-018be608153a req-e7a30c7b-0a20-4bff-85ad-55f490cf0161 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:00.828396 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-df0ea648-9315-420d-a2a1-018be608153a req-e7a30c7b-0a20-4bff-85ad-55f490cf0161 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:00.842043 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-df0ea648-9315-420d-a2a1-018be608153a req-e7a30c7b-0a20-4bff-85ad-55f490cf0161 service nova] Creating event network-vif-plugged:012c5a46-cbe3-4127-98c8-54961f7dbe01 for instance db561480-36d5-4879-aa89-d62bf3623851 on hv-cinder-81914 Feb 15 14:29:00.848256 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-df0ea648-9315-420d-a2a1-018be608153a req-e7a30c7b-0a20-4bff-85ad-55f490cf0161 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036172 Feb 15 14:29:00.849180 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 324/638] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:29:01.218512 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-aa37cc25-1da8-440c-8594-0c54b0cbae19 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:01.219200 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-aa37cc25-1da8-440c-8594-0c54b0cbae19 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:01.226968 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-aa37cc25-1da8-440c-8594-0c54b0cbae19 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:01.227700 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-aa37cc25-1da8-440c-8594-0c54b0cbae19 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:01.228754 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-aa37cc25-1da8-440c-8594-0c54b0cbae19 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:01.229373 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-aa37cc25-1da8-440c-8594-0c54b0cbae19 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:01.378974 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-aa37cc25-1da8-440c-8594-0c54b0cbae19 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:01.386191 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-aa37cc25-1da8-440c-8594-0c54b0cbae19 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1362 microversion: 2.1 time: 0.171347 Feb 15 14:29:01.386761 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 315/639] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:01 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:02.405437 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-bed7e7b2-1cdd-4ece-8d60-5342640000be tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:02.407056 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-bed7e7b2-1cdd-4ece-8d60-5342640000be tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:02.415728 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bed7e7b2-1cdd-4ece-8d60-5342640000be tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:02.416183 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bed7e7b2-1cdd-4ece-8d60-5342640000be tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:02.417014 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bed7e7b2-1cdd-4ece-8d60-5342640000be tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:02.417450 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bed7e7b2-1cdd-4ece-8d60-5342640000be tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:02.652516 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-bed7e7b2-1cdd-4ece-8d60-5342640000be tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:02.663458 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-bed7e7b2-1cdd-4ece-8d60-5342640000be tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1362 microversion: 2.1 time: 0.263558 Feb 15 14:29:02.664060 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 325/640] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:02 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:03.680425 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-24a1f0db-abf7-435f-aa6b-e1dd80a1d49f tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:03.681242 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-24a1f0db-abf7-435f-aa6b-e1dd80a1d49f tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:03.688578 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-24a1f0db-abf7-435f-aa6b-e1dd80a1d49f tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:03.689222 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-24a1f0db-abf7-435f-aa6b-e1dd80a1d49f tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:03.690113 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-24a1f0db-abf7-435f-aa6b-e1dd80a1d49f tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:03.690670 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-24a1f0db-abf7-435f-aa6b-e1dd80a1d49f tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:03.840864 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-24a1f0db-abf7-435f-aa6b-e1dd80a1d49f tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:03.849856 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-24a1f0db-abf7-435f-aa6b-e1dd80a1d49f tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1547 microversion: 2.1 time: 0.173153 Feb 15 14:29:03.850534 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 316/641] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:03 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1547 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:03.867209 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-b594c97d-6acd-470d-8b27-70424a9ad281 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:03.868213 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-b594c97d-6acd-470d-8b27-70424a9ad281 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:03.874975 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b594c97d-6acd-470d-8b27-70424a9ad281 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:03.875515 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b594c97d-6acd-470d-8b27-70424a9ad281 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:03.876301 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b594c97d-6acd-470d-8b27-70424a9ad281 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:03.876926 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b594c97d-6acd-470d-8b27-70424a9ad281 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:04.003355 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-b594c97d-6acd-470d-8b27-70424a9ad281 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.140475 Feb 15 14:29:04.004254 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 326/642] 10.222.0.83 () {58 vars in 1274 bytes} [Tue Feb 15 14:29:03 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:29:04.755449 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-1dcdcb43-bd2d-4215-88bd-ad5d6e4431f6 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:29:04.759139 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-1dcdcb43-bd2d-4215-88bd-ad5d6e4431f6 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:04.771995 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1dcdcb43-bd2d-4215-88bd-ad5d6e4431f6 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:04.772732 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1dcdcb43-bd2d-4215-88bd-ad5d6e4431f6 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:04.774814 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1dcdcb43-bd2d-4215-88bd-ad5d6e4431f6 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:04.776093 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1dcdcb43-bd2d-4215-88bd-ad5d6e4431f6 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:04.885867 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-1dcdcb43-bd2d-4215-88bd-ad5d6e4431f6 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "POST /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7/action" status: 202 len: 0 microversion: 2.1 time: 0.139157 Feb 15 14:29:04.887182 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 317/643] 10.222.0.83 () {60 vars in 1277 bytes} [Tue Feb 15 14:29:04 2022] POST /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:29:04.896092 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-c500896c-ac4d-4d80-8ee4-41556bb46db3 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:04.898630 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-c500896c-ac4d-4d80-8ee4-41556bb46db3 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:04.909425 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c500896c-ac4d-4d80-8ee4-41556bb46db3 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:04.910035 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c500896c-ac4d-4d80-8ee4-41556bb46db3 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:04.910853 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c500896c-ac4d-4d80-8ee4-41556bb46db3 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:04.915048 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c500896c-ac4d-4d80-8ee4-41556bb46db3 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:05.285882 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-c500896c-ac4d-4d80-8ee4-41556bb46db3 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:05.308857 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-c500896c-ac4d-4d80-8ee4-41556bb46db3 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1751 microversion: 2.1 time: 0.416245 Feb 15 14:29:05.310753 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 327/644] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:04 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1751 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:05.653281 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-408381a9-5f64-46a8-8f41-114c7664242a tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:05.653882 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-408381a9-5f64-46a8-8f41-114c7664242a tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:05.658049 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-9cbb8ba4-c48a-4b67-865f-ce0d595a84f7 req-8c980961-54df-45ab-9709-1a62f1163501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db561480-36d5-4879-aa89-d62bf3623851", "tag": "012c5a46-cbe3-4127-98c8-54961f7dbe01"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:29:05.659965 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:29:05.659965 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:29:05.663593 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-408381a9-5f64-46a8-8f41-114c7664242a tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:05.668060 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-9cbb8ba4-c48a-4b67-865f-ce0d595a84f7 req-8c980961-54df-45ab-9709-1a62f1163501 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:05.668246 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-408381a9-5f64-46a8-8f41-114c7664242a tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:05.668582 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-9cbb8ba4-c48a-4b67-865f-ce0d595a84f7 req-8c980961-54df-45ab-9709-1a62f1163501 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:05.669337 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-408381a9-5f64-46a8-8f41-114c7664242a tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:05.669789 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-408381a9-5f64-46a8-8f41-114c7664242a tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:05.683345 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-9cbb8ba4-c48a-4b67-865f-ce0d595a84f7 req-8c980961-54df-45ab-9709-1a62f1163501 service nova] Creating event network-changed:012c5a46-cbe3-4127-98c8-54961f7dbe01 for instance db561480-36d5-4879-aa89-d62bf3623851 on hv-cinder-81914 Feb 15 14:29:05.689047 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-9cbb8ba4-c48a-4b67-865f-ce0d595a84f7 req-8c980961-54df-45ab-9709-1a62f1163501 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035452 Feb 15 14:29:05.690479 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 328/645] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:29:05.718819 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-408381a9-5f64-46a8-8f41-114c7664242a tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851/ips" status: 200 len: 105 microversion: 2.1 time: 0.071946 Feb 15 14:29:05.720139 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 318/646] 10.222.0.83 () {58 vars in 1247 bytes} [Tue Feb 15 14:29:05 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851/ips => generated 105 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:29:06.329678 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-8ba4b755-08d9-4dbe-a63e-786058474eb0 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:06.330595 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-8ba4b755-08d9-4dbe-a63e-786058474eb0 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:06.341492 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8ba4b755-08d9-4dbe-a63e-786058474eb0 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:06.342156 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8ba4b755-08d9-4dbe-a63e-786058474eb0 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:06.343105 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8ba4b755-08d9-4dbe-a63e-786058474eb0 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:06.343696 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8ba4b755-08d9-4dbe-a63e-786058474eb0 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:06.797014 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-8ba4b755-08d9-4dbe-a63e-786058474eb0 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:06.811930 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-8ba4b755-08d9-4dbe-a63e-786058474eb0 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1751 microversion: 2.1 time: 0.487210 Feb 15 14:29:06.820430 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 329/647] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:06 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1751 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:07.831124 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-9c95e057-709c-48a3-9e71-3bc44f067980 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:07.832688 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-9c95e057-709c-48a3-9e71-3bc44f067980 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:07.839780 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9c95e057-709c-48a3-9e71-3bc44f067980 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:07.840581 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9c95e057-709c-48a3-9e71-3bc44f067980 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:07.841577 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9c95e057-709c-48a3-9e71-3bc44f067980 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:07.842391 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9c95e057-709c-48a3-9e71-3bc44f067980 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:08.386484 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-9c95e057-709c-48a3-9e71-3bc44f067980 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:08.394622 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-9c95e057-709c-48a3-9e71-3bc44f067980 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1756 microversion: 2.1 time: 0.567725 Feb 15 14:29:08.395872 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 319/648] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:07 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1756 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:09.412246 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-a6f66724-725f-44b6-9389-e1c932d82950 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:09.413255 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-a6f66724-725f-44b6-9389-e1c932d82950 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:09.427265 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a6f66724-725f-44b6-9389-e1c932d82950 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:09.428265 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a6f66724-725f-44b6-9389-e1c932d82950 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:09.429321 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a6f66724-725f-44b6-9389-e1c932d82950 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:09.429953 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a6f66724-725f-44b6-9389-e1c932d82950 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:09.652757 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a6f66724-725f-44b6-9389-e1c932d82950 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:09.665307 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-a6f66724-725f-44b6-9389-e1c932d82950 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1756 microversion: 2.1 time: 0.257397 Feb 15 14:29:09.665947 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 330/649] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:09 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1756 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:09.854049 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-7a84534e-44ac-439a-b192-a6a354423f58 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Action: 'create', calling method: .version_select at 0x7fd74fee5f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-218978542"}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:29:09.872089 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-7a84534e-44ac-439a-b192-a6a354423f58 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Getting quotas for project 9bc1601015ff4805a2884b047df84013. Resources: {'key_pairs'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:29:09.875912 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-7a84534e-44ac-439a-b192-a6a354423f58 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Getting quotas for user 41a62058dca64450aa608973422ff9bd and project 9bc1601015ff4805a2884b047df84013. Resources: {'key_pairs'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:29:09.990357 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-7a84534e-44ac-439a-b192-a6a354423f58 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Getting quotas for project 9bc1601015ff4805a2884b047df84013. Resources: {'key_pairs'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:29:09.994055 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-7a84534e-44ac-439a-b192-a6a354423f58 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Getting quotas for user 41a62058dca64450aa608973422ff9bd and project 9bc1601015ff4805a2884b047df84013. Resources: {'key_pairs'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:29:10.008201 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-7a84534e-44ac-439a-b192-a6a354423f58 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.315548 Feb 15 14:29:10.009044 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 320/650] 10.222.0.83 () {60 vars in 1157 bytes} [Tue Feb 15 14:29:09 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:10.695202 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-d3f53d29-3379-440e-a2e1-bb63c5034053 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:10.697530 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-d3f53d29-3379-440e-a2e1-bb63c5034053 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:10.704905 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d3f53d29-3379-440e-a2e1-bb63c5034053 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:10.706516 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d3f53d29-3379-440e-a2e1-bb63c5034053 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:10.707570 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d3f53d29-3379-440e-a2e1-bb63c5034053 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:10.708010 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d3f53d29-3379-440e-a2e1-bb63c5034053 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:10.933761 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-d3f53d29-3379-440e-a2e1-bb63c5034053 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:10.948674 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-d3f53d29-3379-440e-a2e1-bb63c5034053 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1756 microversion: 2.1 time: 0.269454 Feb 15 14:29:10.949514 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 331/651] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:10 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1756 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:11.967407 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-c610ba45-b9d3-407e-a2a2-90a6fefb677b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:11.968018 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-c610ba45-b9d3-407e-a2a2-90a6fefb677b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:11.975559 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c610ba45-b9d3-407e-a2a2-90a6fefb677b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:11.976187 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c610ba45-b9d3-407e-a2a2-90a6fefb677b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:11.977435 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c610ba45-b9d3-407e-a2a2-90a6fefb677b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:11.977962 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c610ba45-b9d3-407e-a2a2-90a6fefb677b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:12.138914 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-c610ba45-b9d3-407e-a2a2-90a6fefb677b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:12.147847 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-c610ba45-b9d3-407e-a2a2-90a6fefb677b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1756 microversion: 2.1 time: 0.184501 Feb 15 14:29:12.148526 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 321/652] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:11 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:13.165386 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-4e20a55e-b197-47a7-a52e-bfdfd4ea0f3a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:13.165922 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-4e20a55e-b197-47a7-a52e-bfdfd4ea0f3a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:13.172356 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4e20a55e-b197-47a7-a52e-bfdfd4ea0f3a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:13.172855 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4e20a55e-b197-47a7-a52e-bfdfd4ea0f3a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:13.173625 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4e20a55e-b197-47a7-a52e-bfdfd4ea0f3a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:13.174838 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4e20a55e-b197-47a7-a52e-bfdfd4ea0f3a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:13.419841 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-4e20a55e-b197-47a7-a52e-bfdfd4ea0f3a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:13.427826 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-4e20a55e-b197-47a7-a52e-bfdfd4ea0f3a tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1756 microversion: 2.1 time: 0.266244 Feb 15 14:29:13.428674 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 332/653] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:13 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1756 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:14.446518 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-a2d6fb00-6d0f-4c38-9226-f8358ece7789 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:14.447068 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-a2d6fb00-6d0f-4c38-9226-f8358ece7789 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:14.453756 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a2d6fb00-6d0f-4c38-9226-f8358ece7789 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:14.454243 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a2d6fb00-6d0f-4c38-9226-f8358ece7789 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:14.455297 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a2d6fb00-6d0f-4c38-9226-f8358ece7789 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:14.455822 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a2d6fb00-6d0f-4c38-9226-f8358ece7789 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:14.578831 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-485dd789-bfac-4841-88e4-c9ba9e368076 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:14.578831 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-485dd789-bfac-4841-88e4-c9ba9e368076 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:14.585416 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-485dd789-bfac-4841-88e4-c9ba9e368076 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:14.585859 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-485dd789-bfac-4841-88e4-c9ba9e368076 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:14.587053 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-485dd789-bfac-4841-88e4-c9ba9e368076 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:14.587225 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-485dd789-bfac-4841-88e4-c9ba9e368076 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:14.610121 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-a2d6fb00-6d0f-4c38-9226-f8358ece7789 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:14.619367 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-485dd789-bfac-4841-88e4-c9ba9e368076 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923/os-volume_attachments/c6669416-8409-4fc2-8437-523260877c16" status: 200 len: 194 microversion: 2.20 time: 0.046130 Feb 15 14:29:14.619559 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-a2d6fb00-6d0f-4c38-9226-f8358ece7789 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1756 microversion: 2.1 time: 0.176729 Feb 15 14:29:14.624439 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 322/654] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:14 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:14.624568 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 333/655] 10.222.0.83 () {60 vars in 1453 bytes} [Tue Feb 15 14:29:14 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923/os-volume_attachments/c6669416-8409-4fc2-8437-523260877c16 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 15 14:29:14.688679 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-ef631501-1b56-4f66-8c0f-7ef08e9becd9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:14.689772 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-ef631501-1b56-4f66-8c0f-7ef08e9becd9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:14.695776 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ef631501-1b56-4f66-8c0f-7ef08e9becd9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:14.696222 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ef631501-1b56-4f66-8c0f-7ef08e9becd9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:14.697081 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ef631501-1b56-4f66-8c0f-7ef08e9becd9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:14.697473 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ef631501-1b56-4f66-8c0f-7ef08e9becd9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:14.885383 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.objects.instance [None req-ef631501-1b56-4f66-8c0f-7ef08e9becd9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lazy-loading 'services' on Instance uuid 9c04d927-9f34-4f11-8502-7175a64e3923 {{(pid=116362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:29:14.957848 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-ef631501-1b56-4f66-8c0f-7ef08e9becd9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923/os-volume_attachments/c6669416-8409-4fc2-8437-523260877c16" status: 202 len: 0 microversion: 2.20 time: 0.272728 Feb 15 14:29:14.958454 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 323/656] 10.222.0.83 () {60 vars in 1456 bytes} [Tue Feb 15 14:29:14 2022] DELETE /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923/os-volume_attachments/c6669416-8409-4fc2-8437-523260877c16 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 15 14:29:14.966640 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-8118c212-0c21-468b-b9b8-ce9b71d9d9f7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:14.967633 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-8118c212-0c21-468b-b9b8-ce9b71d9d9f7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:14.974037 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8118c212-0c21-468b-b9b8-ce9b71d9d9f7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:14.974583 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8118c212-0c21-468b-b9b8-ce9b71d9d9f7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:14.975615 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8118c212-0c21-468b-b9b8-ce9b71d9d9f7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:14.976266 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8118c212-0c21-468b-b9b8-ce9b71d9d9f7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:15.009971 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-8118c212-0c21-468b-b9b8-ce9b71d9d9f7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047035 Feb 15 14:29:15.010968 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 334/657] 10.222.0.83 () {60 vars in 1342 bytes} [Tue Feb 15 14:29:14 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 14:29:15.638143 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-f94b59fb-881a-45d0-a345-1a9a79362e71 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:15.640286 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-f94b59fb-881a-45d0-a345-1a9a79362e71 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:15.649512 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f94b59fb-881a-45d0-a345-1a9a79362e71 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:15.650517 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f94b59fb-881a-45d0-a345-1a9a79362e71 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:15.651767 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f94b59fb-881a-45d0-a345-1a9a79362e71 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:15.652651 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f94b59fb-881a-45d0-a345-1a9a79362e71 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:15.859353 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-f94b59fb-881a-45d0-a345-1a9a79362e71 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:15.868525 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-f94b59fb-881a-45d0-a345-1a9a79362e71 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1756 microversion: 2.1 time: 0.235619 Feb 15 14:29:15.875380 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 324/658] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:15 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1756 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:16.022146 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-d6d4abc4-9451-480e-98d4-babfa4c6b731 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:16.023304 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-d6d4abc4-9451-480e-98d4-babfa4c6b731 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:16.031439 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d6d4abc4-9451-480e-98d4-babfa4c6b731 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:16.032518 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d6d4abc4-9451-480e-98d4-babfa4c6b731 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:16.034629 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d6d4abc4-9451-480e-98d4-babfa4c6b731 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:16.034983 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d6d4abc4-9451-480e-98d4-babfa4c6b731 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:16.069052 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-d6d4abc4-9451-480e-98d4-babfa4c6b731 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051739 Feb 15 14:29:16.069644 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 335/659] 10.222.0.83 () {60 vars in 1342 bytes} [Tue Feb 15 14:29:16 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:16.130254 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-247c91d6-4ecf-48cd-bfda-21aa62b83174 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:16.130754 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-247c91d6-4ecf-48cd-bfda-21aa62b83174 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:16.136837 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-247c91d6-4ecf-48cd-bfda-21aa62b83174 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:16.137288 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-247c91d6-4ecf-48cd-bfda-21aa62b83174 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:16.138121 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-247c91d6-4ecf-48cd-bfda-21aa62b83174 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:16.138561 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-247c91d6-4ecf-48cd-bfda-21aa62b83174 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:16.164413 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-247c91d6-4ecf-48cd-bfda-21aa62b83174 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Going to try to terminate instance {{(pid=116362) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 14:29:16.254236 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-247c91d6-4ecf-48cd-bfda-21aa62b83174 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 204 len: 0 microversion: 2.20 time: 0.127490 Feb 15 14:29:16.254827 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 325/660] 10.222.0.83 () {60 vars in 1279 bytes} [Tue Feb 15 14:29:16 2022] DELETE /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 15 14:29:16.262916 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-d32a9508-313e-4004-94e5-8715f190f1e4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:16.263727 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-d32a9508-313e-4004-94e5-8715f190f1e4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:16.271141 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d32a9508-313e-4004-94e5-8715f190f1e4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:16.271594 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d32a9508-313e-4004-94e5-8715f190f1e4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:16.272390 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d32a9508-313e-4004-94e5-8715f190f1e4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:16.272889 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d32a9508-313e-4004-94e5-8715f190f1e4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:16.432784 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-d32a9508-313e-4004-94e5-8715f190f1e4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:16.442629 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-d32a9508-313e-4004-94e5-8715f190f1e4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:16.444821 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-d32a9508-313e-4004-94e5-8715f190f1e4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:16.446520 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-d32a9508-313e-4004-94e5-8715f190f1e4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1722 microversion: 2.20 time: 0.187348 Feb 15 14:29:16.447089 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 336/661] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:29:16 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:29:16.886344 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-060a3a1a-c628-4940-8583-7a1e5c2ecc08 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:16.887036 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-060a3a1a-c628-4940-8583-7a1e5c2ecc08 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:16.893999 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-060a3a1a-c628-4940-8583-7a1e5c2ecc08 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:16.894435 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-060a3a1a-c628-4940-8583-7a1e5c2ecc08 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:16.895203 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-060a3a1a-c628-4940-8583-7a1e5c2ecc08 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:16.895629 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-060a3a1a-c628-4940-8583-7a1e5c2ecc08 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:17.041942 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-060a3a1a-c628-4940-8583-7a1e5c2ecc08 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:17.050195 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-060a3a1a-c628-4940-8583-7a1e5c2ecc08 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1756 microversion: 2.1 time: 0.167804 Feb 15 14:29:17.050762 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 326/662] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:16 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:17.465716 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-f16cc50a-7946-45cd-bd11-dab4c0d228a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:17.466362 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-f16cc50a-7946-45cd-bd11-dab4c0d228a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:17.473709 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f16cc50a-7946-45cd-bd11-dab4c0d228a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:17.474169 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f16cc50a-7946-45cd-bd11-dab4c0d228a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:17.474990 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f16cc50a-7946-45cd-bd11-dab4c0d228a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:17.475422 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f16cc50a-7946-45cd-bd11-dab4c0d228a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:17.614780 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-f16cc50a-7946-45cd-bd11-dab4c0d228a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:17.622524 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-f16cc50a-7946-45cd-bd11-dab4c0d228a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:17.624017 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-f16cc50a-7946-45cd-bd11-dab4c0d228a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:17.625199 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-f16cc50a-7946-45cd-bd11-dab4c0d228a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1722 microversion: 2.20 time: 0.163303 Feb 15 14:29:17.625762 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 337/663] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:29:17 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:29:18.067471 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-945e8585-80c1-4ea0-9c3d-5d9d9f7f1fb2 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:18.067990 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-945e8585-80c1-4ea0-9c3d-5d9d9f7f1fb2 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:18.074285 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-945e8585-80c1-4ea0-9c3d-5d9d9f7f1fb2 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:18.074735 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-945e8585-80c1-4ea0-9c3d-5d9d9f7f1fb2 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:18.075507 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-945e8585-80c1-4ea0-9c3d-5d9d9f7f1fb2 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:18.075941 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-945e8585-80c1-4ea0-9c3d-5d9d9f7f1fb2 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:18.221686 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-945e8585-80c1-4ea0-9c3d-5d9d9f7f1fb2 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:18.229450 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-945e8585-80c1-4ea0-9c3d-5d9d9f7f1fb2 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1756 microversion: 2.1 time: 0.166384 Feb 15 14:29:18.230019 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 327/664] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:18 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:18.643038 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-988452f3-5ea6-4f42-baba-36c57747f590 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:18.643645 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-988452f3-5ea6-4f42-baba-36c57747f590 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:18.650168 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-988452f3-5ea6-4f42-baba-36c57747f590 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:18.650617 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-988452f3-5ea6-4f42-baba-36c57747f590 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:18.651392 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-988452f3-5ea6-4f42-baba-36c57747f590 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:18.651825 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-988452f3-5ea6-4f42-baba-36c57747f590 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:18.852359 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-988452f3-5ea6-4f42-baba-36c57747f590 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:18.863355 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-988452f3-5ea6-4f42-baba-36c57747f590 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:18.865917 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-988452f3-5ea6-4f42-baba-36c57747f590 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:18.871222 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-988452f3-5ea6-4f42-baba-36c57747f590 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 200 len: 1722 microversion: 2.20 time: 0.229507 Feb 15 14:29:18.871222 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 338/665] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:29:18 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:29:19.246568 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-39d3aa2b-629c-45d1-a50a-45c09d431c6d tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:19.247159 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-39d3aa2b-629c-45d1-a50a-45c09d431c6d tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:19.254695 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-39d3aa2b-629c-45d1-a50a-45c09d431c6d tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:19.255139 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-39d3aa2b-629c-45d1-a50a-45c09d431c6d tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:19.255915 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-39d3aa2b-629c-45d1-a50a-45c09d431c6d tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:19.256367 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-39d3aa2b-629c-45d1-a50a-45c09d431c6d tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:19.412999 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-39d3aa2b-629c-45d1-a50a-45c09d431c6d tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:19.420979 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-39d3aa2b-629c-45d1-a50a-45c09d431c6d tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1756 microversion: 2.1 time: 0.178004 Feb 15 14:29:19.421581 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 328/666] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:19 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:19.680988 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-2f4ee951-3272-46c2-8308-6d9d91740534 req-59bdaa61-e4ef-4ae9-b807-436c91526651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c04d927-9f34-4f11-8502-7175a64e3923", "name": "network-vif-deleted", "tag": "23ef841c-69a3-483c-9bb9-680e3d5b6392"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:29:19.688553 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:29:19.688553 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:29:19.693413 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-2f4ee951-3272-46c2-8308-6d9d91740534 req-59bdaa61-e4ef-4ae9-b807-436c91526651 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:19.693888 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-2f4ee951-3272-46c2-8308-6d9d91740534 req-59bdaa61-e4ef-4ae9-b807-436c91526651 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:19.709661 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-2f4ee951-3272-46c2-8308-6d9d91740534 req-59bdaa61-e4ef-4ae9-b807-436c91526651 service nova] Creating event network-vif-deleted:23ef841c-69a3-483c-9bb9-680e3d5b6392 for instance 9c04d927-9f34-4f11-8502-7175a64e3923 on hv-cinder-81914 Feb 15 14:29:19.716222 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-2f4ee951-3272-46c2-8308-6d9d91740534 req-59bdaa61-e4ef-4ae9-b807-436c91526651 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038828 Feb 15 14:29:19.717110 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 339/667] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:29:19.889635 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-20f3a546-d816-4fd4-8f9d-c0b700f3fd5e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:19.890532 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-20f3a546-d816-4fd4-8f9d-c0b700f3fd5e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:19.897985 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-20f3a546-d816-4fd4-8f9d-c0b700f3fd5e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:19.898828 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-20f3a546-d816-4fd4-8f9d-c0b700f3fd5e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:19.900190 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-20f3a546-d816-4fd4-8f9d-c0b700f3fd5e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:19.900739 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-20f3a546-d816-4fd4-8f9d-c0b700f3fd5e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:19.915634 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.wsgi [None req-20f3a546-d816-4fd4-8f9d-c0b700f3fd5e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] HTTP exception thrown: Instance 9c04d927-9f34-4f11-8502-7175a64e3923 could not be found. Feb 15 14:29:19.916568 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-20f3a546-d816-4fd4-8f9d-c0b700f3fd5e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Returning 404 to user: Instance 9c04d927-9f34-4f11-8502-7175a64e3923 could not be found. {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:29:19.917483 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-20f3a546-d816-4fd4-8f9d-c0b700f3fd5e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 404 len: 111 microversion: 2.20 time: 0.032968 Feb 15 14:29:19.918127 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 329/668] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:29:19 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 15 14:29:19.927296 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-fc835e32-d165-424a-9b31-ec201a153a35 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '.version_select at 0x7fd74f543a60>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:19.960628 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-fc835e32-d165-424a-9b31-ec201a153a35 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-143722437" status: 204 len: 0 microversion: 2.20 time: 0.037628 Feb 15 14:29:19.961765 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 340/669] 10.222.0.83 () {60 vars in 1258 bytes} [Tue Feb 15 14:29:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-143722437 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 15 14:29:20.437427 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-b819e405-ea8f-4d8c-8abd-8e9e407caf78 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:20.438704 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-b819e405-ea8f-4d8c-8abd-8e9e407caf78 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:20.446065 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b819e405-ea8f-4d8c-8abd-8e9e407caf78 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:20.446568 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b819e405-ea8f-4d8c-8abd-8e9e407caf78 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:20.447646 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b819e405-ea8f-4d8c-8abd-8e9e407caf78 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:20.448106 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b819e405-ea8f-4d8c-8abd-8e9e407caf78 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:20.623792 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-b819e405-ea8f-4d8c-8abd-8e9e407caf78 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:20.634702 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-b819e405-ea8f-4d8c-8abd-8e9e407caf78 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1756 microversion: 2.1 time: 0.200866 Feb 15 14:29:20.646492 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 330/670] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:20 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1756 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:20.936171 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-e56e65d6-a366-4f61-bd1c-7bf53b8fa445 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Action: 'create', calling method: .version_select at 0x7fd74f653b80>, body: {"keypair": {"name": "tempest-keypair-511061171"}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:29:20.962632 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-e56e65d6-a366-4f61-bd1c-7bf53b8fa445 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Getting quotas for project 061f138bf57a450295694607670540c5. Resources: {'key_pairs'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:29:20.966875 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-e56e65d6-a366-4f61-bd1c-7bf53b8fa445 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Getting quotas for user 85c1d5b9f2f44555ad5d2d79e7adbb28 and project 061f138bf57a450295694607670540c5. Resources: {'key_pairs'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:29:21.156756 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-e56e65d6-a366-4f61-bd1c-7bf53b8fa445 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Getting quotas for project 061f138bf57a450295694607670540c5. Resources: {'key_pairs'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:29:21.160611 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-e56e65d6-a366-4f61-bd1c-7bf53b8fa445 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Getting quotas for user 85c1d5b9f2f44555ad5d2d79e7adbb28 and project 061f138bf57a450295694607670540c5. Resources: {'key_pairs'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:29:21.173426 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-e56e65d6-a366-4f61-bd1c-7bf53b8fa445 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.241491 Feb 15 14:29:21.174113 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 341/671] 10.222.0.83 () {62 vars in 1198 bytes} [Tue Feb 15 14:29:20 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 244 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Feb 15 14:29:21.654062 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-3f725d0a-ca25-4c1b-a2b5-fb04eeeaf085 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:21.654945 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-3f725d0a-ca25-4c1b-a2b5-fb04eeeaf085 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:21.662296 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3f725d0a-ca25-4c1b-a2b5-fb04eeeaf085 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:21.662790 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3f725d0a-ca25-4c1b-a2b5-fb04eeeaf085 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:21.663589 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3f725d0a-ca25-4c1b-a2b5-fb04eeeaf085 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:21.664060 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3f725d0a-ca25-4c1b-a2b5-fb04eeeaf085 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:21.895525 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-3f725d0a-ca25-4c1b-a2b5-fb04eeeaf085 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:21.904019 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-3f725d0a-ca25-4c1b-a2b5-fb04eeeaf085 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1756 microversion: 2.1 time: 0.253967 Feb 15 14:29:21.904627 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 331/672] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:21 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1756 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:22.670691 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-081e2d5e-84f8-4222-8b34-772e44a2e744 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1532919295", "imageRef": "da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0957828b-89e7-4901-abcf-9cdcc101c9e7"}], "security_groups": [{"name": "tempest-securitygroup--396859506"}], "key_name": "tempest-keypair-511061171", "user_data": "}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:29:22.785831 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.network.neutron [None req-081e2d5e-84f8-4222-8b34-772e44a2e744 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] validate_networks() for [('0957828b-89e7-4901-abcf-9cdcc101c9e7', None, None, None, None, None)] {{(pid=116363) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 14:29:22.925602 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-70665a96-3f0c-4b86-bae3-f1936fbb3c44 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:22.927609 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-70665a96-3f0c-4b86-bae3-f1936fbb3c44 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:22.935876 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-70665a96-3f0c-4b86-bae3-f1936fbb3c44 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:22.936837 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-70665a96-3f0c-4b86-bae3-f1936fbb3c44 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:22.938654 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-70665a96-3f0c-4b86-bae3-f1936fbb3c44 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:22.939747 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-70665a96-3f0c-4b86-bae3-f1936fbb3c44 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:23.174638 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-70665a96-3f0c-4b86-bae3-f1936fbb3c44 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:23.183397 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-70665a96-3f0c-4b86-bae3-f1936fbb3c44 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1759 microversion: 2.1 time: 0.265614 Feb 15 14:29:23.184289 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 332/673] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:22 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1759 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:29:23.492426 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-081e2d5e-84f8-4222-8b34-772e44a2e744 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Flavor limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 14:29:23.492853 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-081e2d5e-84f8-4222-8b34-772e44a2e744 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Image limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 14:29:23.493333 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-081e2d5e-84f8-4222-8b34-772e44a2e744 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Flavor pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 14:29:23.494244 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-081e2d5e-84f8-4222-8b34-772e44a2e744 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Image pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 14:29:23.494244 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-081e2d5e-84f8-4222-8b34-772e44a2e744 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 14:29:23.504079 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-081e2d5e-84f8-4222-8b34-772e44a2e744 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:23.504609 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-081e2d5e-84f8-4222-8b34-772e44a2e744 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:23.505426 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-081e2d5e-84f8-4222-8b34-772e44a2e744 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:23.505901 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-081e2d5e-84f8-4222-8b34-772e44a2e744 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:23.523925 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-081e2d5e-84f8-4222-8b34-772e44a2e744 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Getting quotas for project 061f138bf57a450295694607670540c5. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:29:23.527946 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-081e2d5e-84f8-4222-8b34-772e44a2e744 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Getting quotas for user 85c1d5b9f2f44555ad5d2d79e7adbb28 and project 061f138bf57a450295694607670540c5. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:29:23.539964 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-081e2d5e-84f8-4222-8b34-772e44a2e744 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Going to run 1 instances... {{(pid=116363) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 14:29:23.542362 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-081e2d5e-84f8-4222-8b34-772e44a2e744 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 14:29:23.594668 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-081e2d5e-84f8-4222-8b34-772e44a2e744 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.928435 Feb 15 14:29:23.595371 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 342/674] 10.222.0.83 () {62 vars in 1187 bytes} [Tue Feb 15 14:29:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 15 14:29:23.605665 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-74960b55-0dd1-4c95-afd9-849565e98034 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:23.606300 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-74960b55-0dd1-4c95-afd9-849565e98034 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:23.675763 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-74960b55-0dd1-4c95-afd9-849565e98034 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:23.685888 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-74960b55-0dd1-4c95-afd9-849565e98034 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:23.689462 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-74960b55-0dd1-4c95-afd9-849565e98034 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:23.691194 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-74960b55-0dd1-4c95-afd9-849565e98034 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1281 microversion: 2.20 time: 0.089124 Feb 15 14:29:23.692343 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 333/675] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:29:23 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1281 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 14:29:24.711687 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-c4ac7098-7ab7-49ca-9d12-b91067079e70 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:24.712288 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-c4ac7098-7ab7-49ca-9d12-b91067079e70 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:24.718478 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c4ac7098-7ab7-49ca-9d12-b91067079e70 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:24.718920 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c4ac7098-7ab7-49ca-9d12-b91067079e70 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:24.719675 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c4ac7098-7ab7-49ca-9d12-b91067079e70 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:24.721076 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c4ac7098-7ab7-49ca-9d12-b91067079e70 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:24.780740 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-c4ac7098-7ab7-49ca-9d12-b91067079e70 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:24.789479 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-c4ac7098-7ab7-49ca-9d12-b91067079e70 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:24.790952 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-c4ac7098-7ab7-49ca-9d12-b91067079e70 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:24.792046 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-c4ac7098-7ab7-49ca-9d12-b91067079e70 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1333 microversion: 2.20 time: 0.084596 Feb 15 14:29:24.792627 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 343/676] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:29:24 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1333 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:29:25.810389 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-033af4c8-b3b1-4116-ae5f-20855687a23e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:25.810998 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-033af4c8-b3b1-4116-ae5f-20855687a23e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:25.817600 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-033af4c8-b3b1-4116-ae5f-20855687a23e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:25.818055 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-033af4c8-b3b1-4116-ae5f-20855687a23e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:25.818838 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-033af4c8-b3b1-4116-ae5f-20855687a23e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:25.819280 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-033af4c8-b3b1-4116-ae5f-20855687a23e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:25.951858 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-033af4c8-b3b1-4116-ae5f-20855687a23e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:25.960471 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-033af4c8-b3b1-4116-ae5f-20855687a23e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:25.961970 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-033af4c8-b3b1-4116-ae5f-20855687a23e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:25.963073 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-033af4c8-b3b1-4116-ae5f-20855687a23e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1406 microversion: 2.20 time: 0.156471 Feb 15 14:29:25.963631 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 334/677] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:29:25 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:29:26.248804 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-071135f5-7074-4f9a-a8ef-4e3dd011d54c req-66bbbf17-d3f5-4733-879b-8a516b17551c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1deaae9b-7503-48ca-a476-5814a26e51e0", "tag": "9bcff6b8-b07d-43be-bb6c-2f956f455705"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:29:26.250374 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:29:26.250374 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:29:26.262456 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-071135f5-7074-4f9a-a8ef-4e3dd011d54c req-66bbbf17-d3f5-4733-879b-8a516b17551c service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:26.263163 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-071135f5-7074-4f9a-a8ef-4e3dd011d54c req-66bbbf17-d3f5-4733-879b-8a516b17551c service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:26.278780 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-071135f5-7074-4f9a-a8ef-4e3dd011d54c req-66bbbf17-d3f5-4733-879b-8a516b17551c service nova] Creating event network-changed:9bcff6b8-b07d-43be-bb6c-2f956f455705 for instance 1deaae9b-7503-48ca-a476-5814a26e51e0 on hv-cinder-81914 Feb 15 14:29:26.284663 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-071135f5-7074-4f9a-a8ef-4e3dd011d54c req-66bbbf17-d3f5-4733-879b-8a516b17551c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040673 Feb 15 14:29:26.285868 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 344/678] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:29:27.033281 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-958d8a1b-9422-4d7b-8233-8131b9fbc215 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:27.033899 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-958d8a1b-9422-4d7b-8233-8131b9fbc215 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:27.040147 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-958d8a1b-9422-4d7b-8233-8131b9fbc215 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:27.040671 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-958d8a1b-9422-4d7b-8233-8131b9fbc215 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:27.041462 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-958d8a1b-9422-4d7b-8233-8131b9fbc215 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:27.041903 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-958d8a1b-9422-4d7b-8233-8131b9fbc215 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:27.181207 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-958d8a1b-9422-4d7b-8233-8131b9fbc215 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:27.189593 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-958d8a1b-9422-4d7b-8233-8131b9fbc215 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:27.191246 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-958d8a1b-9422-4d7b-8233-8131b9fbc215 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:27.192347 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-958d8a1b-9422-4d7b-8233-8131b9fbc215 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1406 microversion: 2.20 time: 0.215347 Feb 15 14:29:27.192942 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 335/679] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:29:26 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:29:28.210707 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-af2d92a3-1974-43e1-9466-bf5fbf0716e9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:28.211411 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-af2d92a3-1974-43e1-9466-bf5fbf0716e9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:28.217539 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-af2d92a3-1974-43e1-9466-bf5fbf0716e9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:28.217986 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-af2d92a3-1974-43e1-9466-bf5fbf0716e9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:28.218754 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-af2d92a3-1974-43e1-9466-bf5fbf0716e9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:28.219186 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-af2d92a3-1974-43e1-9466-bf5fbf0716e9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:28.351591 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-af2d92a3-1974-43e1-9466-bf5fbf0716e9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:28.359208 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-af2d92a3-1974-43e1-9466-bf5fbf0716e9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:28.361238 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-af2d92a3-1974-43e1-9466-bf5fbf0716e9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:28.362375 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-af2d92a3-1974-43e1-9466-bf5fbf0716e9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1406 microversion: 2.20 time: 0.156194 Feb 15 14:29:28.362940 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 345/680] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:29:28 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:29:29.380570 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-fa1d9bb5-1be3-42e5-80bd-b3ad0cd31745 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:29.381186 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-fa1d9bb5-1be3-42e5-80bd-b3ad0cd31745 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:29.387694 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fa1d9bb5-1be3-42e5-80bd-b3ad0cd31745 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:29.388140 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fa1d9bb5-1be3-42e5-80bd-b3ad0cd31745 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:29.388949 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fa1d9bb5-1be3-42e5-80bd-b3ad0cd31745 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:29.389381 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fa1d9bb5-1be3-42e5-80bd-b3ad0cd31745 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:29.521523 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-fa1d9bb5-1be3-42e5-80bd-b3ad0cd31745 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:29.529526 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-fa1d9bb5-1be3-42e5-80bd-b3ad0cd31745 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:29.531021 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-fa1d9bb5-1be3-42e5-80bd-b3ad0cd31745 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:29.532624 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-fa1d9bb5-1be3-42e5-80bd-b3ad0cd31745 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1406 microversion: 2.20 time: 0.156091 Feb 15 14:29:29.533348 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 336/681] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:29:29 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:29:30.550566 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-8edb9b6e-c1e3-42a2-b1ff-20b917c0232d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:30.551101 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-8edb9b6e-c1e3-42a2-b1ff-20b917c0232d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:30.557366 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8edb9b6e-c1e3-42a2-b1ff-20b917c0232d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:30.557809 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8edb9b6e-c1e3-42a2-b1ff-20b917c0232d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:30.558580 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8edb9b6e-c1e3-42a2-b1ff-20b917c0232d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:30.559017 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8edb9b6e-c1e3-42a2-b1ff-20b917c0232d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:30.667405 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-66068234-bf91-4af9-8d80-dff9ae3b99f9 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-893824117", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-218978542", "security_groups": [{"name": "tempest-secgroup-smoke-2122136391"}], "block_device_mapping_v2": [{"uuid": "476028f3-5e9b-4364-87e9-e4b365689521", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f56af738-73d1-43bd-9e25-bf9a658bed0c"}]}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:29:30.706935 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-8edb9b6e-c1e3-42a2-b1ff-20b917c0232d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:30.715570 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-8edb9b6e-c1e3-42a2-b1ff-20b917c0232d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:30.717134 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-8edb9b6e-c1e3-42a2-b1ff-20b917c0232d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:30.718455 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-8edb9b6e-c1e3-42a2-b1ff-20b917c0232d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1406 microversion: 2.20 time: 0.172075 Feb 15 14:29:30.719017 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 346/682] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:29:30 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:29:30.759392 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-c20c0964-886a-4eae-9ad7-f54edea1238d req-142088f7-a566-4879-8cc2-b51cbf5a920d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1deaae9b-7503-48ca-a476-5814a26e51e0", "name": "network-vif-plugged", "status": "completed", "tag": "9bcff6b8-b07d-43be-bb6c-2f956f455705"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:29:30.760989 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:29:30.760989 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:29:30.768996 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-c20c0964-886a-4eae-9ad7-f54edea1238d req-142088f7-a566-4879-8cc2-b51cbf5a920d service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:30.769441 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-c20c0964-886a-4eae-9ad7-f54edea1238d req-142088f7-a566-4879-8cc2-b51cbf5a920d service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:30.780766 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-c20c0964-886a-4eae-9ad7-f54edea1238d req-142088f7-a566-4879-8cc2-b51cbf5a920d service nova] Creating event network-vif-plugged:9bcff6b8-b07d-43be-bb6c-2f956f455705 for instance 1deaae9b-7503-48ca-a476-5814a26e51e0 on hv-cinder-81914 Feb 15 14:29:30.786075 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-c20c0964-886a-4eae-9ad7-f54edea1238d req-142088f7-a566-4879-8cc2-b51cbf5a920d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030679 Feb 15 14:29:30.786220 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.network.neutron [None req-66068234-bf91-4af9-8d80-dff9ae3b99f9 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] validate_networks() for [('f56af738-73d1-43bd-9e25-bf9a658bed0c', None, None, None, None, None)] {{(pid=116362) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 14:29:30.786671 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 347/683] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:29:31.214993 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-66068234-bf91-4af9-8d80-dff9ae3b99f9 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Flavor limits 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 14:29:31.215418 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-66068234-bf91-4af9-8d80-dff9ae3b99f9 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Image limits 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 14:29:31.215894 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-66068234-bf91-4af9-8d80-dff9ae3b99f9 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Flavor pref 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 14:29:31.216544 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-66068234-bf91-4af9-8d80-dff9ae3b99f9 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Image pref 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 14:29:31.216798 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-66068234-bf91-4af9-8d80-dff9ae3b99f9 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 14:29:31.226282 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-66068234-bf91-4af9-8d80-dff9ae3b99f9 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:31.226783 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-66068234-bf91-4af9-8d80-dff9ae3b99f9 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:31.227547 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-66068234-bf91-4af9-8d80-dff9ae3b99f9 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:31.227986 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-66068234-bf91-4af9-8d80-dff9ae3b99f9 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:31.244797 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-66068234-bf91-4af9-8d80-dff9ae3b99f9 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Getting quotas for project 9bc1601015ff4805a2884b047df84013. Resources: {'instances', 'ram', 'cores'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:29:31.248705 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-66068234-bf91-4af9-8d80-dff9ae3b99f9 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Getting quotas for user 41a62058dca64450aa608973422ff9bd and project 9bc1601015ff4805a2884b047df84013. Resources: {'instances', 'ram', 'cores'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:29:31.302605 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-66068234-bf91-4af9-8d80-dff9ae3b99f9 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Going to run 1 instances... {{(pid=116362) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 14:29:31.304774 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-66068234-bf91-4af9-8d80-dff9ae3b99f9 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 8808332d-30a8-493a-99cd-e95447b41793] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='476028f3-5e9b-4364-87e9-e4b365689521',volume_size=None,volume_type=None)] {{(pid=116362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 14:29:31.424689 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-66068234-bf91-4af9-8d80-dff9ae3b99f9 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.762272 Feb 15 14:29:31.425341 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 337/684] 10.222.0.83 () {60 vars in 1146 bytes} [Tue Feb 15 14:29:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 15 14:29:31.435611 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-7d55025b-e5f1-457d-b088-04e7bedef50a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:31.436303 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-7d55025b-e5f1-457d-b088-04e7bedef50a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 8808332d-30a8-493a-99cd-e95447b41793] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:31.489343 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-7d55025b-e5f1-457d-b088-04e7bedef50a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:31.495910 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-7d55025b-e5f1-457d-b088-04e7bedef50a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793" status: 200 len: 1093 microversion: 2.1 time: 0.064270 Feb 15 14:29:31.496490 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 348/685] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:31 2022] GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:31.737113 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-b20a05ad-6c1a-4471-9478-3ff145bff623 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:31.738348 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-b20a05ad-6c1a-4471-9478-3ff145bff623 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:31.744919 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b20a05ad-6c1a-4471-9478-3ff145bff623 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:31.745448 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b20a05ad-6c1a-4471-9478-3ff145bff623 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:31.746310 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b20a05ad-6c1a-4471-9478-3ff145bff623 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:31.746825 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b20a05ad-6c1a-4471-9478-3ff145bff623 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:31.885079 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-b20a05ad-6c1a-4471-9478-3ff145bff623 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:31.893075 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-b20a05ad-6c1a-4471-9478-3ff145bff623 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:31.894558 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-b20a05ad-6c1a-4471-9478-3ff145bff623 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:31.895644 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-b20a05ad-6c1a-4471-9478-3ff145bff623 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1406 microversion: 2.20 time: 0.163128 Feb 15 14:29:31.896193 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 338/686] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:29:31 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:29:32.513952 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-db116424-0e45-41f5-948e-0f4d8624bb02 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:32.514501 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-db116424-0e45-41f5-948e-0f4d8624bb02 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 8808332d-30a8-493a-99cd-e95447b41793] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:32.520974 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-db116424-0e45-41f5-948e-0f4d8624bb02 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:32.521671 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-db116424-0e45-41f5-948e-0f4d8624bb02 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:32.522453 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-db116424-0e45-41f5-948e-0f4d8624bb02 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:32.522889 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-db116424-0e45-41f5-948e-0f4d8624bb02 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:32.612045 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-db116424-0e45-41f5-948e-0f4d8624bb02 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:32.621707 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-db116424-0e45-41f5-948e-0f4d8624bb02 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793" status: 200 len: 1199 microversion: 2.1 time: 0.111483 Feb 15 14:29:32.622707 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 349/687] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:32 2022] GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793 => generated 1199 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:32.913715 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-707bbe77-c367-4b96-b947-d0a25c46f550 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:32.914895 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-707bbe77-c367-4b96-b947-d0a25c46f550 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:32.921130 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-707bbe77-c367-4b96-b947-d0a25c46f550 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:32.921585 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-707bbe77-c367-4b96-b947-d0a25c46f550 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:32.922365 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-707bbe77-c367-4b96-b947-d0a25c46f550 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:32.923333 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-707bbe77-c367-4b96-b947-d0a25c46f550 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:33.065823 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-707bbe77-c367-4b96-b947-d0a25c46f550 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:33.074493 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-707bbe77-c367-4b96-b947-d0a25c46f550 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:33.075992 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-707bbe77-c367-4b96-b947-d0a25c46f550 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:33.077234 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-707bbe77-c367-4b96-b947-d0a25c46f550 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1597 microversion: 2.20 time: 0.167313 Feb 15 14:29:33.077793 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 339/688] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:29:32 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1597 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:29:33.095764 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-e0eb4493-1364-4838-ac1d-0a85ed84a698 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:33.096536 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-e0eb4493-1364-4838-ac1d-0a85ed84a698 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:33.102318 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e0eb4493-1364-4838-ac1d-0a85ed84a698 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:33.102770 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e0eb4493-1364-4838-ac1d-0a85ed84a698 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:33.103547 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e0eb4493-1364-4838-ac1d-0a85ed84a698 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:33.103987 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e0eb4493-1364-4838-ac1d-0a85ed84a698 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:33.259864 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-e0eb4493-1364-4838-ac1d-0a85ed84a698 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.167861 Feb 15 14:29:33.265669 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 350/689] 10.222.0.83 () {60 vars in 1315 bytes} [Tue Feb 15 14:29:33 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 14:29:33.639345 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-9eb47c09-472c-4e9e-9691-a609817415b2 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:33.640623 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-9eb47c09-472c-4e9e-9691-a609817415b2 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 8808332d-30a8-493a-99cd-e95447b41793] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:33.647492 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9eb47c09-472c-4e9e-9691-a609817415b2 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:33.648069 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9eb47c09-472c-4e9e-9691-a609817415b2 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:33.649009 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9eb47c09-472c-4e9e-9691-a609817415b2 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:33.651730 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9eb47c09-472c-4e9e-9691-a609817415b2 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:34.184484 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-9eb47c09-472c-4e9e-9691-a609817415b2 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:34.195622 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-9eb47c09-472c-4e9e-9691-a609817415b2 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793" status: 200 len: 1265 microversion: 2.1 time: 0.559873 Feb 15 14:29:34.196289 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 340/690] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:33 2022] GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793 => generated 1265 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:34.241911 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-038ccb4d-50b1-4350-b5b3-7b346247b956 req-13c66b83-8325-417e-92fa-16f5a8adf718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8808332d-30a8-493a-99cd-e95447b41793", "tag": "105c6fc7-9772-45c2-b2d2-16cff04ab385"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:29:34.243425 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:29:34.243425 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:29:34.253348 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-038ccb4d-50b1-4350-b5b3-7b346247b956 req-13c66b83-8325-417e-92fa-16f5a8adf718 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:34.254043 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-038ccb4d-50b1-4350-b5b3-7b346247b956 req-13c66b83-8325-417e-92fa-16f5a8adf718 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:34.283968 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-038ccb4d-50b1-4350-b5b3-7b346247b956 req-13c66b83-8325-417e-92fa-16f5a8adf718 service nova] Creating event network-changed:105c6fc7-9772-45c2-b2d2-16cff04ab385 for instance 8808332d-30a8-493a-99cd-e95447b41793 on hv-cinder-81914 Feb 15 14:29:34.295798 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-038ccb4d-50b1-4350-b5b3-7b346247b956 req-13c66b83-8325-417e-92fa-16f5a8adf718 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058045 Feb 15 14:29:34.297080 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 351/691] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:29:34.654639 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-45a0bf80-9fcf-44a1-bb87-56092c6d5b77 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:34.655140 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-45a0bf80-9fcf-44a1-bb87-56092c6d5b77 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:34.658736 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-aa270851-419a-4aa3-b367-ec0d7e246ae2 req-0684b566-794c-4d64-8768-fc5502f5812a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1deaae9b-7503-48ca-a476-5814a26e51e0", "tag": "9bcff6b8-b07d-43be-bb6c-2f956f455705"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:29:34.660680 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:29:34.660680 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:29:34.661898 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-45a0bf80-9fcf-44a1-bb87-56092c6d5b77 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:34.662606 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-45a0bf80-9fcf-44a1-bb87-56092c6d5b77 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:34.663572 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-45a0bf80-9fcf-44a1-bb87-56092c6d5b77 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:34.664171 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-45a0bf80-9fcf-44a1-bb87-56092c6d5b77 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:34.671582 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-aa270851-419a-4aa3-b367-ec0d7e246ae2 req-0684b566-794c-4d64-8768-fc5502f5812a service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:34.672328 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-aa270851-419a-4aa3-b367-ec0d7e246ae2 req-0684b566-794c-4d64-8768-fc5502f5812a service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:34.683919 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-aa270851-419a-4aa3-b367-ec0d7e246ae2 req-0684b566-794c-4d64-8768-fc5502f5812a service nova] Creating event network-changed:9bcff6b8-b07d-43be-bb6c-2f956f455705 for instance 1deaae9b-7503-48ca-a476-5814a26e51e0 on hv-cinder-81914 Feb 15 14:29:34.690129 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-aa270851-419a-4aa3-b367-ec0d7e246ae2 req-0684b566-794c-4d64-8768-fc5502f5812a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036542 Feb 15 14:29:34.691198 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 352/692] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:29:34.694037 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-45a0bf80-9fcf-44a1-bb87-56092c6d5b77 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0/ips" status: 200 len: 111 microversion: 2.20 time: 0.043780 Feb 15 14:29:34.694614 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 341/693] 10.222.0.83 () {60 vars in 1288 bytes} [Tue Feb 15 14:29:34 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0/ips => generated 111 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 14:29:35.217872 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-589c7cda-11f5-4eda-9673-778ada6d37ae tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:35.218585 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-589c7cda-11f5-4eda-9673-778ada6d37ae tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 8808332d-30a8-493a-99cd-e95447b41793] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:35.226617 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-589c7cda-11f5-4eda-9673-778ada6d37ae tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:35.227365 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-589c7cda-11f5-4eda-9673-778ada6d37ae tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:35.228138 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-589c7cda-11f5-4eda-9673-778ada6d37ae tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:35.228830 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-589c7cda-11f5-4eda-9673-778ada6d37ae tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:35.459493 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-589c7cda-11f5-4eda-9673-778ada6d37ae tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:35.467272 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-589c7cda-11f5-4eda-9673-778ada6d37ae tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793" status: 200 len: 1265 microversion: 2.1 time: 0.255016 Feb 15 14:29:35.467955 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 353/694] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:35 2022] GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:29:36.484247 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-ad18d041-aadf-41ed-944e-cac22ed057ee tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:36.485000 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-ad18d041-aadf-41ed-944e-cac22ed057ee tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 8808332d-30a8-493a-99cd-e95447b41793] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:36.491485 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ad18d041-aadf-41ed-944e-cac22ed057ee tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:36.491927 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ad18d041-aadf-41ed-944e-cac22ed057ee tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:36.492721 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ad18d041-aadf-41ed-944e-cac22ed057ee tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:36.493151 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ad18d041-aadf-41ed-944e-cac22ed057ee tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:36.629872 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-ad18d041-aadf-41ed-944e-cac22ed057ee tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:36.637150 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-ad18d041-aadf-41ed-944e-cac22ed057ee tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793" status: 200 len: 1265 microversion: 2.1 time: 0.156541 Feb 15 14:29:36.637745 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 342/695] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:36 2022] GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:37.654413 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-aa044401-c48b-4d12-94e6-24335d8f255d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:37.655008 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-aa044401-c48b-4d12-94e6-24335d8f255d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 8808332d-30a8-493a-99cd-e95447b41793] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:37.662137 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-aa044401-c48b-4d12-94e6-24335d8f255d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:37.662579 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-aa044401-c48b-4d12-94e6-24335d8f255d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:37.663354 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-aa044401-c48b-4d12-94e6-24335d8f255d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:37.663791 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-aa044401-c48b-4d12-94e6-24335d8f255d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:37.794299 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-aa044401-c48b-4d12-94e6-24335d8f255d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:37.801774 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-aa044401-c48b-4d12-94e6-24335d8f255d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793" status: 200 len: 1265 microversion: 2.1 time: 0.151440 Feb 15 14:29:37.802546 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 354/696] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:37 2022] GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:38.818793 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-1b08b40c-d08f-4ffa-962e-aac637f8321b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:38.819409 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-1b08b40c-d08f-4ffa-962e-aac637f8321b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 8808332d-30a8-493a-99cd-e95447b41793] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:38.825863 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1b08b40c-d08f-4ffa-962e-aac637f8321b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:38.826323 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1b08b40c-d08f-4ffa-962e-aac637f8321b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:38.827100 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1b08b40c-d08f-4ffa-962e-aac637f8321b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:38.827539 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1b08b40c-d08f-4ffa-962e-aac637f8321b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:38.959580 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-1b08b40c-d08f-4ffa-962e-aac637f8321b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:38.966833 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-1b08b40c-d08f-4ffa-962e-aac637f8321b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793" status: 200 len: 1265 microversion: 2.1 time: 0.151725 Feb 15 14:29:38.967401 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 343/697] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:38 2022] GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:39.982902 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-799ba3dc-28e5-478a-b1fb-5f6381cb560f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:39.983504 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-799ba3dc-28e5-478a-b1fb-5f6381cb560f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 8808332d-30a8-493a-99cd-e95447b41793] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:39.990008 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-799ba3dc-28e5-478a-b1fb-5f6381cb560f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:39.990454 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-799ba3dc-28e5-478a-b1fb-5f6381cb560f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:39.991232 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-799ba3dc-28e5-478a-b1fb-5f6381cb560f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:39.991667 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-799ba3dc-28e5-478a-b1fb-5f6381cb560f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:40.128384 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-799ba3dc-28e5-478a-b1fb-5f6381cb560f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:40.135644 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-799ba3dc-28e5-478a-b1fb-5f6381cb560f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793" status: 200 len: 1265 microversion: 2.1 time: 0.156427 Feb 15 14:29:40.136153 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 355/698] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:39 2022] GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:41.153055 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-9ee3f67e-dd02-4244-bfc1-c4507327532d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:41.153585 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-9ee3f67e-dd02-4244-bfc1-c4507327532d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 8808332d-30a8-493a-99cd-e95447b41793] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:41.160714 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9ee3f67e-dd02-4244-bfc1-c4507327532d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:41.161165 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9ee3f67e-dd02-4244-bfc1-c4507327532d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:41.161948 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9ee3f67e-dd02-4244-bfc1-c4507327532d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:41.162385 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9ee3f67e-dd02-4244-bfc1-c4507327532d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:41.296092 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-9ee3f67e-dd02-4244-bfc1-c4507327532d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:41.303584 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-9ee3f67e-dd02-4244-bfc1-c4507327532d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793" status: 200 len: 1265 microversion: 2.1 time: 0.154513 Feb 15 14:29:41.304147 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 344/699] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:41 2022] GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:42.320159 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-da6cd07b-4a59-4524-a7b1-f3f0867a3f32 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:42.320795 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-da6cd07b-4a59-4524-a7b1-f3f0867a3f32 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 8808332d-30a8-493a-99cd-e95447b41793] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:42.327044 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-da6cd07b-4a59-4524-a7b1-f3f0867a3f32 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:42.327480 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-da6cd07b-4a59-4524-a7b1-f3f0867a3f32 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:42.329024 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-da6cd07b-4a59-4524-a7b1-f3f0867a3f32 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:42.329463 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-da6cd07b-4a59-4524-a7b1-f3f0867a3f32 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:42.460428 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-da6cd07b-4a59-4524-a7b1-f3f0867a3f32 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:42.467619 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-da6cd07b-4a59-4524-a7b1-f3f0867a3f32 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793" status: 200 len: 1265 microversion: 2.1 time: 0.151084 Feb 15 14:29:42.468190 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 356/700] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:42 2022] GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:43.484221 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-3273eede-519f-48ba-859a-684d9c11d199 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:43.485486 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-3273eede-519f-48ba-859a-684d9c11d199 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 8808332d-30a8-493a-99cd-e95447b41793] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:43.491705 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3273eede-519f-48ba-859a-684d9c11d199 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:43.492156 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3273eede-519f-48ba-859a-684d9c11d199 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:43.492966 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3273eede-519f-48ba-859a-684d9c11d199 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:43.493404 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3273eede-519f-48ba-859a-684d9c11d199 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:43.629663 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-3273eede-519f-48ba-859a-684d9c11d199 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:43.636929 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-3273eede-519f-48ba-859a-684d9c11d199 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793" status: 200 len: 1265 microversion: 2.1 time: 0.156417 Feb 15 14:29:43.637493 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 345/701] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:43 2022] GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:44.654153 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-e3e4f2c3-18f5-45e8-aaf7-0b19950879b3 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:44.654766 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-e3e4f2c3-18f5-45e8-aaf7-0b19950879b3 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 8808332d-30a8-493a-99cd-e95447b41793] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:44.662176 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e3e4f2c3-18f5-45e8-aaf7-0b19950879b3 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:44.662609 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e3e4f2c3-18f5-45e8-aaf7-0b19950879b3 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:44.663404 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e3e4f2c3-18f5-45e8-aaf7-0b19950879b3 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:44.663835 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e3e4f2c3-18f5-45e8-aaf7-0b19950879b3 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:44.803692 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-7820cf0a-369a-42c1-b208-fccaed2b0dc6 req-728d3f44-3eb9-4015-84fe-9e12a072a606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8808332d-30a8-493a-99cd-e95447b41793", "name": "network-vif-plugged", "status": "completed", "tag": "105c6fc7-9772-45c2-b2d2-16cff04ab385"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:29:44.809003 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:29:44.809003 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:29:44.818036 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-7820cf0a-369a-42c1-b208-fccaed2b0dc6 req-728d3f44-3eb9-4015-84fe-9e12a072a606 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:44.818842 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-7820cf0a-369a-42c1-b208-fccaed2b0dc6 req-728d3f44-3eb9-4015-84fe-9e12a072a606 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:44.826015 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-e3e4f2c3-18f5-45e8-aaf7-0b19950879b3 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:44.834300 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-e3e4f2c3-18f5-45e8-aaf7-0b19950879b3 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793" status: 200 len: 1265 microversion: 2.1 time: 0.184239 Feb 15 14:29:44.835093 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 357/702] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:44 2022] GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:44.841365 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-7820cf0a-369a-42c1-b208-fccaed2b0dc6 req-728d3f44-3eb9-4015-84fe-9e12a072a606 service nova] Creating event network-vif-plugged:105c6fc7-9772-45c2-b2d2-16cff04ab385 for instance 8808332d-30a8-493a-99cd-e95447b41793 on hv-cinder-81914 Feb 15 14:29:44.847055 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-7820cf0a-369a-42c1-b208-fccaed2b0dc6 req-728d3f44-3eb9-4015-84fe-9e12a072a606 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051776 Feb 15 14:29:44.847675 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 346/703] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:29:45.850769 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-4f3a2e83-7abe-46fa-a331-4ed3a07d97e8 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:45.851380 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-4f3a2e83-7abe-46fa-a331-4ed3a07d97e8 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 8808332d-30a8-493a-99cd-e95447b41793] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:45.857729 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4f3a2e83-7abe-46fa-a331-4ed3a07d97e8 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:45.858171 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4f3a2e83-7abe-46fa-a331-4ed3a07d97e8 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:45.858929 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4f3a2e83-7abe-46fa-a331-4ed3a07d97e8 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:45.859489 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4f3a2e83-7abe-46fa-a331-4ed3a07d97e8 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:45.992234 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-4f3a2e83-7abe-46fa-a331-4ed3a07d97e8 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:45.999699 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-4f3a2e83-7abe-46fa-a331-4ed3a07d97e8 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793" status: 200 len: 1265 microversion: 2.1 time: 0.152476 Feb 15 14:29:46.000906 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 358/704] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:45 2022] GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:47.017511 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-8375a960-6d91-4f48-ad3c-6d9b717f19a7 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:47.018216 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-8375a960-6d91-4f48-ad3c-6d9b717f19a7 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 8808332d-30a8-493a-99cd-e95447b41793] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:47.024275 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8375a960-6d91-4f48-ad3c-6d9b717f19a7 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:47.024759 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8375a960-6d91-4f48-ad3c-6d9b717f19a7 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:47.025533 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8375a960-6d91-4f48-ad3c-6d9b717f19a7 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:47.025974 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8375a960-6d91-4f48-ad3c-6d9b717f19a7 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:47.162075 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-8375a960-6d91-4f48-ad3c-6d9b717f19a7 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:47.170339 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-8375a960-6d91-4f48-ad3c-6d9b717f19a7 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793" status: 200 len: 1451 microversion: 2.1 time: 0.157902 Feb 15 14:29:47.170912 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 347/705] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:47 2022] GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:47.186969 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-7f9036ec-033d-43b8-86f0-15b69d94b92b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:29:47.188223 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-7f9036ec-033d-43b8-86f0-15b69d94b92b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 8808332d-30a8-493a-99cd-e95447b41793] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:47.194724 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7f9036ec-033d-43b8-86f0-15b69d94b92b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:47.195173 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7f9036ec-033d-43b8-86f0-15b69d94b92b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:47.195942 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7f9036ec-033d-43b8-86f0-15b69d94b92b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:47.196378 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7f9036ec-033d-43b8-86f0-15b69d94b92b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:47.330448 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-7f9036ec-033d-43b8-86f0-15b69d94b92b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:29:47.337887 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-7f9036ec-033d-43b8-86f0-15b69d94b92b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793" status: 200 len: 1451 microversion: 2.1 time: 0.154848 Feb 15 14:29:47.338471 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 359/706] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:29:47 2022] GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:29:49.011207 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-8cf30c41-a44f-4dc0-af29-99380881590d req-5bcbe9f7-ad48-4b5a-bff1-fa4815e68f5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8808332d-30a8-493a-99cd-e95447b41793", "tag": "105c6fc7-9772-45c2-b2d2-16cff04ab385"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:29:49.012858 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:29:49.012858 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:29:49.019758 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-8cf30c41-a44f-4dc0-af29-99380881590d req-5bcbe9f7-ad48-4b5a-bff1-fa4815e68f5f service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:49.020201 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-8cf30c41-a44f-4dc0-af29-99380881590d req-5bcbe9f7-ad48-4b5a-bff1-fa4815e68f5f service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:49.031641 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-8cf30c41-a44f-4dc0-af29-99380881590d req-5bcbe9f7-ad48-4b5a-bff1-fa4815e68f5f service nova] Creating event network-changed:105c6fc7-9772-45c2-b2d2-16cff04ab385 for instance 8808332d-30a8-493a-99cd-e95447b41793 on hv-cinder-81914 Feb 15 14:29:49.036554 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-8cf30c41-a44f-4dc0-af29-99380881590d req-5bcbe9f7-ad48-4b5a-bff1-fa4815e68f5f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085534 Feb 15 14:29:49.037079 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 348/707] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:29:57.006587 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-5388f959-3812-432a-9825-4f2a489a9957 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "278ef4ed-75e8-42c3-8806-8835a154efa0"}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:29:57.007727 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-5388f959-3812-432a-9825-4f2a489a9957 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:29:57.013539 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5388f959-3812-432a-9825-4f2a489a9957 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:57.013987 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5388f959-3812-432a-9825-4f2a489a9957 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:57.014760 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5388f959-3812-432a-9825-4f2a489a9957 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:29:57.015890 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5388f959-3812-432a-9825-4f2a489a9957 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:29:57.260703 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-5388f959-3812-432a-9825-4f2a489a9957 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "POST /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257807 Feb 15 14:29:57.261318 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 360/708] 10.222.0.83 () {60 vars in 1322 bytes} [Tue Feb 15 14:29:57 2022] POST /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:30:04.718592 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-0920198c-1a06-434f-a92b-41cb8bc407d5 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:30:04.724752 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0920198c-1a06-434f-a92b-41cb8bc407d5 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:04.725207 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0920198c-1a06-434f-a92b-41cb8bc407d5 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:04.784088 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-0920198c-1a06-434f-a92b-41cb8bc407d5 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Going to try to stop instance {{(pid=116362) force_stop /opt/stack/nova/nova/compute/api.py:2674}} Feb 15 14:30:04.824773 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-0920198c-1a06-434f-a92b-41cb8bc407d5 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "POST /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851/action" status: 202 len: 0 microversion: 2.1 time: 0.110563 Feb 15 14:30:04.825360 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 349/709] 10.222.0.83 () {60 vars in 1277 bytes} [Tue Feb 15 14:30:04 2022] POST /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:30:04.834273 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-316d8163-b304-4afa-83f5-5557e085c421 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:04.834972 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-316d8163-b304-4afa-83f5-5557e085c421 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:04.841302 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-316d8163-b304-4afa-83f5-5557e085c421 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:04.841981 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-316d8163-b304-4afa-83f5-5557e085c421 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:04.843272 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-316d8163-b304-4afa-83f5-5557e085c421 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:04.843701 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-316d8163-b304-4afa-83f5-5557e085c421 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:04.979423 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-316d8163-b304-4afa-83f5-5557e085c421 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:04.987940 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-316d8163-b304-4afa-83f5-5557e085c421 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1722 microversion: 2.1 time: 0.158084 Feb 15 14:30:04.988526 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 361/710] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:30:04 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:30:06.006791 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-1dfbc666-1b0a-435b-ba7b-e06b786bf8a6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:06.007493 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-1dfbc666-1b0a-435b-ba7b-e06b786bf8a6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:06.013590 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1dfbc666-1b0a-435b-ba7b-e06b786bf8a6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:06.014041 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1dfbc666-1b0a-435b-ba7b-e06b786bf8a6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:06.014932 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1dfbc666-1b0a-435b-ba7b-e06b786bf8a6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:06.015369 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1dfbc666-1b0a-435b-ba7b-e06b786bf8a6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:06.151974 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-1dfbc666-1b0a-435b-ba7b-e06b786bf8a6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:06.160354 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-1dfbc666-1b0a-435b-ba7b-e06b786bf8a6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1722 microversion: 2.1 time: 0.158067 Feb 15 14:30:06.160946 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 350/711] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:30:06 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:30:07.177676 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-f1662dfd-aeb5-44b7-8a6c-8225b9575dca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:07.178203 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-f1662dfd-aeb5-44b7-8a6c-8225b9575dca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:07.184494 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f1662dfd-aeb5-44b7-8a6c-8225b9575dca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:07.184952 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f1662dfd-aeb5-44b7-8a6c-8225b9575dca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:07.185727 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f1662dfd-aeb5-44b7-8a6c-8225b9575dca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:07.186208 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f1662dfd-aeb5-44b7-8a6c-8225b9575dca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:07.315857 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-f1662dfd-aeb5-44b7-8a6c-8225b9575dca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:07.323635 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-f1662dfd-aeb5-44b7-8a6c-8225b9575dca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1722 microversion: 2.1 time: 0.149709 Feb 15 14:30:07.324201 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 362/712] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:30:07 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:30:08.341032 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-43169f17-39d2-477e-a568-83e73e067630 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:08.341639 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-43169f17-39d2-477e-a568-83e73e067630 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:08.348199 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-43169f17-39d2-477e-a568-83e73e067630 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:08.348686 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-43169f17-39d2-477e-a568-83e73e067630 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:08.349471 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-43169f17-39d2-477e-a568-83e73e067630 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:08.349908 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-43169f17-39d2-477e-a568-83e73e067630 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:08.479739 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-43169f17-39d2-477e-a568-83e73e067630 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:08.488054 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-43169f17-39d2-477e-a568-83e73e067630 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1722 microversion: 2.1 time: 0.150659 Feb 15 14:30:08.488648 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 351/713] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:30:08 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:30:09.504932 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-495d7224-8e28-4cd5-a082-a86a85464658 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:09.505542 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-495d7224-8e28-4cd5-a082-a86a85464658 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:09.511818 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-495d7224-8e28-4cd5-a082-a86a85464658 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:09.512267 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-495d7224-8e28-4cd5-a082-a86a85464658 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:09.513068 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-495d7224-8e28-4cd5-a082-a86a85464658 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:09.513505 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-495d7224-8e28-4cd5-a082-a86a85464658 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:09.648731 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-495d7224-8e28-4cd5-a082-a86a85464658 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:09.658670 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-495d7224-8e28-4cd5-a082-a86a85464658 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1722 microversion: 2.1 time: 0.157444 Feb 15 14:30:09.659247 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 363/714] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:30:09 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:30:10.675870 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-77e7d7f8-a51d-425c-8b04-b4c19df742c6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:10.676580 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-77e7d7f8-a51d-425c-8b04-b4c19df742c6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:10.682845 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-77e7d7f8-a51d-425c-8b04-b4c19df742c6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:10.683294 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-77e7d7f8-a51d-425c-8b04-b4c19df742c6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:10.684067 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-77e7d7f8-a51d-425c-8b04-b4c19df742c6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:10.684539 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-77e7d7f8-a51d-425c-8b04-b4c19df742c6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:10.819903 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-77e7d7f8-a51d-425c-8b04-b4c19df742c6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:10.828486 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-77e7d7f8-a51d-425c-8b04-b4c19df742c6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1722 microversion: 2.1 time: 0.155594 Feb 15 14:30:10.829086 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 352/715] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:30:10 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:30:11.846413 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-94606c21-5724-4e4d-9caf-6ec984cd389b tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:11.847048 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-94606c21-5724-4e4d-9caf-6ec984cd389b tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:11.853392 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-94606c21-5724-4e4d-9caf-6ec984cd389b tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:11.853844 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-94606c21-5724-4e4d-9caf-6ec984cd389b tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:11.854617 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-94606c21-5724-4e4d-9caf-6ec984cd389b tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:11.855052 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-94606c21-5724-4e4d-9caf-6ec984cd389b tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:11.985439 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-94606c21-5724-4e4d-9caf-6ec984cd389b tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:11.993074 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-94606c21-5724-4e4d-9caf-6ec984cd389b tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1722 microversion: 2.1 time: 0.151027 Feb 15 14:30:11.993641 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 364/716] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:30:11 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:30:13.009761 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-8f6b4f67-f126-42b3-ab22-9c8b56a34452 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:13.010301 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-8f6b4f67-f126-42b3-ab22-9c8b56a34452 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:13.016655 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8f6b4f67-f126-42b3-ab22-9c8b56a34452 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:13.017105 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8f6b4f67-f126-42b3-ab22-9c8b56a34452 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:13.017879 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8f6b4f67-f126-42b3-ab22-9c8b56a34452 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:13.018316 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8f6b4f67-f126-42b3-ab22-9c8b56a34452 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:13.149611 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-8f6b4f67-f126-42b3-ab22-9c8b56a34452 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:13.158278 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-8f6b4f67-f126-42b3-ab22-9c8b56a34452 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1722 microversion: 2.1 time: 0.152229 Feb 15 14:30:13.158850 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 353/717] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:30:13 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:30:14.175136 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-6fc07b95-29d8-48d4-acc7-ebe1a1e2489d tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:14.175665 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-6fc07b95-29d8-48d4-acc7-ebe1a1e2489d tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:14.181984 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6fc07b95-29d8-48d4-acc7-ebe1a1e2489d tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:14.182437 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6fc07b95-29d8-48d4-acc7-ebe1a1e2489d tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:14.183214 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6fc07b95-29d8-48d4-acc7-ebe1a1e2489d tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:14.183653 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6fc07b95-29d8-48d4-acc7-ebe1a1e2489d tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:14.317091 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-6fc07b95-29d8-48d4-acc7-ebe1a1e2489d tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:14.324861 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-6fc07b95-29d8-48d4-acc7-ebe1a1e2489d tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1722 microversion: 2.1 time: 0.153436 Feb 15 14:30:14.325436 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 365/718] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:30:14 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:30:15.342367 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-f6dd6203-f70e-49ad-8cf8-d12f94d2c1be tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:15.343039 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-f6dd6203-f70e-49ad-8cf8-d12f94d2c1be tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:15.349537 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f6dd6203-f70e-49ad-8cf8-d12f94d2c1be tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:15.349989 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f6dd6203-f70e-49ad-8cf8-d12f94d2c1be tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:15.350761 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f6dd6203-f70e-49ad-8cf8-d12f94d2c1be tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:15.351212 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f6dd6203-f70e-49ad-8cf8-d12f94d2c1be tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:15.483988 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-f6dd6203-f70e-49ad-8cf8-d12f94d2c1be tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:15.491809 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-f6dd6203-f70e-49ad-8cf8-d12f94d2c1be tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1699 microversion: 2.1 time: 0.153101 Feb 15 14:30:15.492383 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 354/719] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:30:15 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1699 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:30:15.508913 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-bbe4e57a-94c2-4616-9808-ab932e0fa82b tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:30:15.515960 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bbe4e57a-94c2-4616-9808-ab932e0fa82b tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:15.516420 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-bbe4e57a-94c2-4616-9808-ab932e0fa82b tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:15.575942 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-bbe4e57a-94c2-4616-9808-ab932e0fa82b tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Going to try to start instance {{(pid=116363) start /opt/stack/nova/nova/compute/api.py:2697}} Feb 15 14:30:15.618463 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-bbe4e57a-94c2-4616-9808-ab932e0fa82b tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "POST /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851/action" status: 202 len: 0 microversion: 2.1 time: 0.113084 Feb 15 14:30:15.619022 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 366/720] 10.222.0.83 () {60 vars in 1277 bytes} [Tue Feb 15 14:30:15 2022] POST /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:30:15.628432 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-c35c47c8-a8a9-4eae-aad1-9214cbe01df8 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:15.629147 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-c35c47c8-a8a9-4eae-aad1-9214cbe01df8 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:15.635025 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c35c47c8-a8a9-4eae-aad1-9214cbe01df8 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:15.635413 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c35c47c8-a8a9-4eae-aad1-9214cbe01df8 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:15.636199 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c35c47c8-a8a9-4eae-aad1-9214cbe01df8 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:15.636720 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c35c47c8-a8a9-4eae-aad1-9214cbe01df8 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:15.776856 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-c35c47c8-a8a9-4eae-aad1-9214cbe01df8 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:15.785363 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-c35c47c8-a8a9-4eae-aad1-9214cbe01df8 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1708 microversion: 2.1 time: 0.161967 Feb 15 14:30:15.785930 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 355/721] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:30:15 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1708 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:30:16.803916 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-fac4ecf9-3d0b-4ec7-9cc7-aecbe0a500ef tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:16.804592 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-fac4ecf9-3d0b-4ec7-9cc7-aecbe0a500ef tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:16.810911 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-fac4ecf9-3d0b-4ec7-9cc7-aecbe0a500ef tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:16.811364 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-fac4ecf9-3d0b-4ec7-9cc7-aecbe0a500ef tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:16.812141 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-fac4ecf9-3d0b-4ec7-9cc7-aecbe0a500ef tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:16.812616 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-fac4ecf9-3d0b-4ec7-9cc7-aecbe0a500ef tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:16.946818 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-fac4ecf9-3d0b-4ec7-9cc7-aecbe0a500ef tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:16.954754 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-fac4ecf9-3d0b-4ec7-9cc7-aecbe0a500ef tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1708 microversion: 2.1 time: 0.155437 Feb 15 14:30:16.955316 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 367/722] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:30:16 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1708 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:30:17.971959 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-8697b767-f038-40f6-9d85-b53c572f0c77 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:17.972527 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-8697b767-f038-40f6-9d85-b53c572f0c77 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:17.979132 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8697b767-f038-40f6-9d85-b53c572f0c77 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:17.979616 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8697b767-f038-40f6-9d85-b53c572f0c77 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:17.980427 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8697b767-f038-40f6-9d85-b53c572f0c77 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:17.980856 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8697b767-f038-40f6-9d85-b53c572f0c77 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:18.118206 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-8697b767-f038-40f6-9d85-b53c572f0c77 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:18.126878 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-8697b767-f038-40f6-9d85-b53c572f0c77 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1712 microversion: 2.1 time: 0.159593 Feb 15 14:30:18.127665 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 356/723] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:30:17 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1712 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:30:26.888312 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-d60abb28-d86b-41ab-a58e-4b547a4071f3 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-512324652"}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:30:26.888877 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-d60abb28-d86b-41ab-a58e-4b547a4071f3 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:26.895740 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d60abb28-d86b-41ab-a58e-4b547a4071f3 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:26.896189 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d60abb28-d86b-41ab-a58e-4b547a4071f3 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:26.896984 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d60abb28-d86b-41ab-a58e-4b547a4071f3 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:26.897423 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d60abb28-d86b-41ab-a58e-4b547a4071f3 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:27.027379 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.network.security_group_api [None req-d60abb28-d86b-41ab-a58e-4b547a4071f3 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Removing security group 11b02767-e3f1-427f-b295-b415de9ae61b from port 2628aace-ae5c-4b38-940c-d120d41232de Feb 15 14:30:27.369217 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-d60abb28-d86b-41ab-a58e-4b547a4071f3 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "POST /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7/action" status: 202 len: 0 microversion: 2.1 time: 0.484545 Feb 15 14:30:27.389968 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 368/724] 10.222.0.83 () {60 vars in 1277 bytes} [Tue Feb 15 14:30:26 2022] POST /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:30:27.391661 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-932e05a3-fe27-465c-b56a-1f1082dddd8e req-4d108b7c-8a45-4c9e-b02f-b18674881118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e14d18-ad60-48d1-8a93-b30daacb8ce7", "tag": "2628aace-ae5c-4b38-940c-d120d41232de"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:30:27.393612 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:30:27.393612 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:30:27.402356 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-932e05a3-fe27-465c-b56a-1f1082dddd8e req-4d108b7c-8a45-4c9e-b02f-b18674881118 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:27.403056 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-932e05a3-fe27-465c-b56a-1f1082dddd8e req-4d108b7c-8a45-4c9e-b02f-b18674881118 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:27.419153 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-932e05a3-fe27-465c-b56a-1f1082dddd8e req-4d108b7c-8a45-4c9e-b02f-b18674881118 service nova] Creating event network-changed:2628aace-ae5c-4b38-940c-d120d41232de for instance e5e14d18-ad60-48d1-8a93-b30daacb8ce7 on hv-cinder-81914 Feb 15 14:30:27.426228 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-932e05a3-fe27-465c-b56a-1f1082dddd8e req-4d108b7c-8a45-4c9e-b02f-b18674881118 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053118 Feb 15 14:30:27.427520 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 357/725] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:30:28.533385 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-4df55aa6-afe5-4b0b-87c6-44455706ae8b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:28.533891 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-4df55aa6-afe5-4b0b-87c6-44455706ae8b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:28.539969 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4df55aa6-afe5-4b0b-87c6-44455706ae8b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:28.540432 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4df55aa6-afe5-4b0b-87c6-44455706ae8b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:28.541230 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4df55aa6-afe5-4b0b-87c6-44455706ae8b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:28.541848 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4df55aa6-afe5-4b0b-87c6-44455706ae8b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:28.619375 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-2c9b5eb6-1123-4ea5-84c1-0520a711627a req-43035806-cf83-47dd-820e-43cee9caa39f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e14d18-ad60-48d1-8a93-b30daacb8ce7", "tag": "2628aace-ae5c-4b38-940c-d120d41232de"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:30:28.621164 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:30:28.621164 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:30:28.630408 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-2c9b5eb6-1123-4ea5-84c1-0520a711627a req-43035806-cf83-47dd-820e-43cee9caa39f service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:28.630910 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-2c9b5eb6-1123-4ea5-84c1-0520a711627a req-43035806-cf83-47dd-820e-43cee9caa39f service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:28.631584 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.objects.instance [None req-4df55aa6-afe5-4b0b-87c6-44455706ae8b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lazy-loading 'services' on Instance uuid e5e14d18-ad60-48d1-8a93-b30daacb8ce7 {{(pid=116363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:30:28.644194 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-2c9b5eb6-1123-4ea5-84c1-0520a711627a req-43035806-cf83-47dd-820e-43cee9caa39f service nova] Creating event network-changed:2628aace-ae5c-4b38-940c-d120d41232de for instance e5e14d18-ad60-48d1-8a93-b30daacb8ce7 on hv-cinder-81914 Feb 15 14:30:28.650285 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-2c9b5eb6-1123-4ea5-84c1-0520a711627a req-43035806-cf83-47dd-820e-43cee9caa39f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124331 Feb 15 14:30:28.652024 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 358/726] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:30:28.715933 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-4df55aa6-afe5-4b0b-87c6-44455706ae8b tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "DELETE /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7/os-volume_attachments/affc90e6-d313-47c4-9285-92d51af2e337" status: 202 len: 0 microversion: 2.1 time: 0.194668 Feb 15 14:30:28.716927 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 369/727] 10.222.0.83 () {58 vars in 1415 bytes} [Tue Feb 15 14:30:28 2022] DELETE /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7/os-volume_attachments/affc90e6-d313-47c4-9285-92d51af2e337 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:30:28.726743 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-a8b79632-0ed7-4582-958c-1ab4e2eb0b42 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:28.728148 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-a8b79632-0ed7-4582-958c-1ab4e2eb0b42 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:28.735823 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a8b79632-0ed7-4582-958c-1ab4e2eb0b42 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:28.736717 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a8b79632-0ed7-4582-958c-1ab4e2eb0b42 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:28.737821 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a8b79632-0ed7-4582-958c-1ab4e2eb0b42 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:28.738468 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a8b79632-0ed7-4582-958c-1ab4e2eb0b42 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:28.776736 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-a8b79632-0ed7-4582-958c-1ab4e2eb0b42 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054642 Feb 15 14:30:28.777325 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 359/728] 10.222.0.83 () {58 vars in 1301 bytes} [Tue Feb 15 14:30:28 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:30:29.790496 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-04f7d6a1-e025-4d92-8bcd-ecf553181fe9 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:29.792537 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-04f7d6a1-e025-4d92-8bcd-ecf553181fe9 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:29.798094 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-04f7d6a1-e025-4d92-8bcd-ecf553181fe9 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:29.798548 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-04f7d6a1-e025-4d92-8bcd-ecf553181fe9 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:29.799329 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-04f7d6a1-e025-4d92-8bcd-ecf553181fe9 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:29.799765 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-04f7d6a1-e025-4d92-8bcd-ecf553181fe9 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:29.831646 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-04f7d6a1-e025-4d92-8bcd-ecf553181fe9 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045861 Feb 15 14:30:29.832385 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 370/729] 10.222.0.83 () {58 vars in 1301 bytes} [Tue Feb 15 14:30:29 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 14:30:29.849327 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-4b92ed35-0ec4-43d3-9077-b37ce03755dd tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:29.849923 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-4b92ed35-0ec4-43d3-9077-b37ce03755dd tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:29.856337 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4b92ed35-0ec4-43d3-9077-b37ce03755dd tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:29.856893 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4b92ed35-0ec4-43d3-9077-b37ce03755dd tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:29.857736 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4b92ed35-0ec4-43d3-9077-b37ce03755dd tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:29.858173 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4b92ed35-0ec4-43d3-9077-b37ce03755dd tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:29.930435 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.wsgi [None req-4b92ed35-0ec4-43d3-9077-b37ce03755dd tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] HTTP exception thrown: Instance e5e14d18-ad60-48d1-8a93-b30daacb8ce7 is not attached to volume affc90e6-d313-47c4-9285-92d51af2e337 Feb 15 14:30:29.931041 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-4b92ed35-0ec4-43d3-9077-b37ce03755dd tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Returning 404 to user: Instance e5e14d18-ad60-48d1-8a93-b30daacb8ce7 is not attached to volume affc90e6-d313-47c4-9285-92d51af2e337 {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:30:29.931997 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-4b92ed35-0ec4-43d3-9077-b37ce03755dd tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "DELETE /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7/os-volume_attachments/affc90e6-d313-47c4-9285-92d51af2e337" status: 404 len: 154 microversion: 2.1 time: 0.091383 Feb 15 14:30:29.932578 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 360/730] 10.222.0.83 () {58 vars in 1415 bytes} [Tue Feb 15 14:30:29 2022] DELETE /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7/os-volume_attachments/affc90e6-d313-47c4-9285-92d51af2e337 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 15 14:30:31.059787 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-1e6bb349-8c97-42ba-8d9b-6ac044ccd440 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:31.060283 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-1e6bb349-8c97-42ba-8d9b-6ac044ccd440 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:31.067369 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1e6bb349-8c97-42ba-8d9b-6ac044ccd440 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:31.067814 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1e6bb349-8c97-42ba-8d9b-6ac044ccd440 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:31.068612 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1e6bb349-8c97-42ba-8d9b-6ac044ccd440 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:31.069052 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1e6bb349-8c97-42ba-8d9b-6ac044ccd440 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:31.088099 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-0eb4917b-c0da-4bc3-8448-99bc6e6ff60d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:30:31.088738 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-0eb4917b-c0da-4bc3-8448-99bc6e6ff60d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:31.093100 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-1e6bb349-8c97-42ba-8d9b-6ac044ccd440 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Going to try to terminate instance {{(pid=116363) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 14:30:31.095185 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0eb4917b-c0da-4bc3-8448-99bc6e6ff60d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:31.095705 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0eb4917b-c0da-4bc3-8448-99bc6e6ff60d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:31.096515 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0eb4917b-c0da-4bc3-8448-99bc6e6ff60d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:31.096956 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0eb4917b-c0da-4bc3-8448-99bc6e6ff60d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:31.119827 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.objects.instance [None req-0eb4917b-c0da-4bc3-8448-99bc6e6ff60d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lazy-loading 'flavor' on Instance uuid 1deaae9b-7503-48ca-a476-5814a26e51e0 {{(pid=116362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:30:31.170074 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-1e6bb349-8c97-42ba-8d9b-6ac044ccd440 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "DELETE /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 204 len: 0 microversion: 2.1 time: 0.113495 Feb 15 14:30:31.170754 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 371/731] 10.222.0.83 () {58 vars in 1238 bytes} [Tue Feb 15 14:30:31 2022] DELETE /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 14:30:31.179178 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-f6a32cf7-0320-4a7c-8238-48fd0473129e tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:31.179979 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-f6a32cf7-0320-4a7c-8238-48fd0473129e tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:31.185968 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f6a32cf7-0320-4a7c-8238-48fd0473129e tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:31.186495 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f6a32cf7-0320-4a7c-8238-48fd0473129e tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:31.188113 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f6a32cf7-0320-4a7c-8238-48fd0473129e tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:31.188652 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f6a32cf7-0320-4a7c-8238-48fd0473129e tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:31.326056 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-f6a32cf7-0320-4a7c-8238-48fd0473129e tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:31.333541 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-f6a32cf7-0320-4a7c-8238-48fd0473129e tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1554 microversion: 2.1 time: 0.158248 Feb 15 14:30:31.334958 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 372/732] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:30:31 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:30:31.386861 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-0eb4917b-c0da-4bc3-8448-99bc6e6ff60d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "POST /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0/action" status: 202 len: 0 microversion: 2.20 time: 0.302216 Feb 15 14:30:31.387473 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 361/733] 10.222.0.83 () {62 vars in 1318 bytes} [Tue Feb 15 14:30:31 2022] POST /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 15 14:30:31.395434 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-d0e6a573-7d49-4593-9580-0f39050d6bb1 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:31.396044 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-d0e6a573-7d49-4593-9580-0f39050d6bb1 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:31.402232 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d0e6a573-7d49-4593-9580-0f39050d6bb1 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:31.402724 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d0e6a573-7d49-4593-9580-0f39050d6bb1 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:31.403713 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d0e6a573-7d49-4593-9580-0f39050d6bb1 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:31.404260 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-d0e6a573-7d49-4593-9580-0f39050d6bb1 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:31.538640 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-d0e6a573-7d49-4593-9580-0f39050d6bb1 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:31.546235 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-d0e6a573-7d49-4593-9580-0f39050d6bb1 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:31.547760 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-d0e6a573-7d49-4593-9580-0f39050d6bb1 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:31.548953 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-d0e6a573-7d49-4593-9580-0f39050d6bb1 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1722 microversion: 2.20 time: 0.157170 Feb 15 14:30:31.549511 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 373/734] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:30:31 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:30:32.352041 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-6b593c09-c715-4faf-b186-63468d9df427 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:32.352776 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-6b593c09-c715-4faf-b186-63468d9df427 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:32.359953 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6b593c09-c715-4faf-b186-63468d9df427 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:32.360421 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6b593c09-c715-4faf-b186-63468d9df427 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:32.361214 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6b593c09-c715-4faf-b186-63468d9df427 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:32.361653 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6b593c09-c715-4faf-b186-63468d9df427 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:32.493768 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-6b593c09-c715-4faf-b186-63468d9df427 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:32.501343 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-6b593c09-c715-4faf-b186-63468d9df427 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1554 microversion: 2.1 time: 0.153922 Feb 15 14:30:32.501913 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 362/735] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:30:32 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:30:32.566546 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-22c5e36c-e137-46ec-a51e-94525f3a8a79 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:32.567144 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-22c5e36c-e137-46ec-a51e-94525f3a8a79 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:32.573481 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-22c5e36c-e137-46ec-a51e-94525f3a8a79 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:32.573922 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-22c5e36c-e137-46ec-a51e-94525f3a8a79 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:32.574680 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-22c5e36c-e137-46ec-a51e-94525f3a8a79 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:32.575110 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-22c5e36c-e137-46ec-a51e-94525f3a8a79 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:32.708027 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-22c5e36c-e137-46ec-a51e-94525f3a8a79 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:32.715643 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-22c5e36c-e137-46ec-a51e-94525f3a8a79 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:32.717159 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-22c5e36c-e137-46ec-a51e-94525f3a8a79 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:32.718878 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-22c5e36c-e137-46ec-a51e-94525f3a8a79 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1722 microversion: 2.20 time: 0.155443 Feb 15 14:30:32.719452 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 374/736] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:30:32 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:30:33.517937 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-68a09ee5-9006-4090-b9de-af356a20bfb8 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:33.518554 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-68a09ee5-9006-4090-b9de-af356a20bfb8 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:33.524953 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-68a09ee5-9006-4090-b9de-af356a20bfb8 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:33.525686 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-68a09ee5-9006-4090-b9de-af356a20bfb8 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:33.526468 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-68a09ee5-9006-4090-b9de-af356a20bfb8 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:33.526912 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-68a09ee5-9006-4090-b9de-af356a20bfb8 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:33.662417 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-68a09ee5-9006-4090-b9de-af356a20bfb8 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:33.669694 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-68a09ee5-9006-4090-b9de-af356a20bfb8 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1554 microversion: 2.1 time: 0.155453 Feb 15 14:30:33.670264 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 363/737] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:30:33 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:30:33.737186 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-010eaa66-e4ec-4335-93b9-bf3fff188342 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:33.737791 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-010eaa66-e4ec-4335-93b9-bf3fff188342 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:33.744036 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-010eaa66-e4ec-4335-93b9-bf3fff188342 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:33.744519 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-010eaa66-e4ec-4335-93b9-bf3fff188342 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:33.745296 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-010eaa66-e4ec-4335-93b9-bf3fff188342 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:33.745730 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-010eaa66-e4ec-4335-93b9-bf3fff188342 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:33.890011 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-010eaa66-e4ec-4335-93b9-bf3fff188342 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:33.898281 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-010eaa66-e4ec-4335-93b9-bf3fff188342 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:33.899768 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-010eaa66-e4ec-4335-93b9-bf3fff188342 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:33.901224 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-010eaa66-e4ec-4335-93b9-bf3fff188342 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1722 microversion: 2.20 time: 0.168237 Feb 15 14:30:33.901790 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 375/738] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:30:33 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:30:34.517074 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-fe75b1dc-0d87-4510-95f1-cb32ebf0dbc8 req-bf9ba06d-1ec5-4ec5-8a2f-7cdd8a2450eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e14d18-ad60-48d1-8a93-b30daacb8ce7", "name": "network-vif-deleted", "tag": "2628aace-ae5c-4b38-940c-d120d41232de"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:30:34.518672 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:30:34.518672 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:30:34.527416 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-fe75b1dc-0d87-4510-95f1-cb32ebf0dbc8 req-bf9ba06d-1ec5-4ec5-8a2f-7cdd8a2450eb service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:34.527875 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-fe75b1dc-0d87-4510-95f1-cb32ebf0dbc8 req-bf9ba06d-1ec5-4ec5-8a2f-7cdd8a2450eb service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:34.540009 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-fe75b1dc-0d87-4510-95f1-cb32ebf0dbc8 req-bf9ba06d-1ec5-4ec5-8a2f-7cdd8a2450eb service nova] Creating event network-vif-deleted:2628aace-ae5c-4b38-940c-d120d41232de for instance e5e14d18-ad60-48d1-8a93-b30daacb8ce7 on hv-cinder-81914 Feb 15 14:30:34.544986 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-fe75b1dc-0d87-4510-95f1-cb32ebf0dbc8 req-bf9ba06d-1ec5-4ec5-8a2f-7cdd8a2450eb service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032145 Feb 15 14:30:34.545910 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 364/739] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:30:34.687385 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-f502ed7b-2e87-49cf-b11c-3f59bac31c75 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:34.687918 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-f502ed7b-2e87-49cf-b11c-3f59bac31c75 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:34.693801 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f502ed7b-2e87-49cf-b11c-3f59bac31c75 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:34.694248 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f502ed7b-2e87-49cf-b11c-3f59bac31c75 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:34.695021 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f502ed7b-2e87-49cf-b11c-3f59bac31c75 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:34.695457 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f502ed7b-2e87-49cf-b11c-3f59bac31c75 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:34.883606 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f502ed7b-2e87-49cf-b11c-3f59bac31c75 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:34.884153 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f502ed7b-2e87-49cf-b11c-3f59bac31c75 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:34.884532 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.objects.instance [None req-f502ed7b-2e87-49cf-b11c-3f59bac31c75 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lazy-loading 'fault' on Instance uuid e5e14d18-ad60-48d1-8a93-b30daacb8ce7 {{(pid=116363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:30:34.920695 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-430a6f10-8a39-4a57-8afc-52c2de29d11c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:34.921619 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-430a6f10-8a39-4a57-8afc-52c2de29d11c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:34.927475 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-f502ed7b-2e87-49cf-b11c-3f59bac31c75 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03cfb060fa954b5db63c9fe31bfad1ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b838dafad384c2a9df8223904cffd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:34.928665 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-430a6f10-8a39-4a57-8afc-52c2de29d11c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:34.929118 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-430a6f10-8a39-4a57-8afc-52c2de29d11c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:34.929905 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-430a6f10-8a39-4a57-8afc-52c2de29d11c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:34.930819 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-430a6f10-8a39-4a57-8afc-52c2de29d11c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:34.934809 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-f502ed7b-2e87-49cf-b11c-3f59bac31c75 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 200 len: 1348 microversion: 2.1 time: 0.251659 Feb 15 14:30:34.935390 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 376/740] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:30:34 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 1348 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:30:35.067966 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-430a6f10-8a39-4a57-8afc-52c2de29d11c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:35.076028 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-430a6f10-8a39-4a57-8afc-52c2de29d11c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:35.077646 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-430a6f10-8a39-4a57-8afc-52c2de29d11c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:35.078819 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-430a6f10-8a39-4a57-8afc-52c2de29d11c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1722 microversion: 2.20 time: 0.162256 Feb 15 14:30:35.079374 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 365/741] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:30:34 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 14:30:35.952184 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-9e6bc391-7cca-4883-a387-57a27c8458ca tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:35.952996 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-9e6bc391-7cca-4883-a387-57a27c8458ca tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] [instance: e5e14d18-ad60-48d1-8a93-b30daacb8ce7] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:35.959250 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9e6bc391-7cca-4883-a387-57a27c8458ca tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:35.959695 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9e6bc391-7cca-4883-a387-57a27c8458ca tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:35.960503 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9e6bc391-7cca-4883-a387-57a27c8458ca tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:35.960941 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9e6bc391-7cca-4883-a387-57a27c8458ca tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:35.975928 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.wsgi [None req-9e6bc391-7cca-4883-a387-57a27c8458ca tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] HTTP exception thrown: Instance e5e14d18-ad60-48d1-8a93-b30daacb8ce7 could not be found. Feb 15 14:30:35.976558 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-9e6bc391-7cca-4883-a387-57a27c8458ca tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Returning 404 to user: Instance e5e14d18-ad60-48d1-8a93-b30daacb8ce7 could not be found. {{(pid=116363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:30:35.977387 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-9e6bc391-7cca-4883-a387-57a27c8458ca tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7" status: 404 len: 111 microversion: 2.1 time: 0.028952 Feb 15 14:30:35.977926 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 377/742] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:30:35 2022] GET /compute/v2.1/servers/e5e14d18-ad60-48d1-8a93-b30daacb8ce7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:30:35.986763 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-adca7d16-96aa-4cfb-9686-a5617489a916 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] Calling method '.version_select at 0x7fd74ff74040>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:36.005646 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-adca7d16-96aa-4cfb-9686-a5617489a916 tempest-TestMinimumBasicScenario-1892602200 tempest-TestMinimumBasicScenario-1892602200-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-297716378" status: 202 len: 0 microversion: 2.1 time: 0.023349 Feb 15 14:30:36.006217 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 366/743] 10.222.0.83 () {58 vars in 1268 bytes} [Tue Feb 15 14:30:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-297716378 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:30:36.097266 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-4a0ca5b4-926c-46c2-a933-359a4d69acfd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:36.097877 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-4a0ca5b4-926c-46c2-a933-359a4d69acfd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:36.103640 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4a0ca5b4-926c-46c2-a933-359a4d69acfd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:36.104096 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4a0ca5b4-926c-46c2-a933-359a4d69acfd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:36.104930 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4a0ca5b4-926c-46c2-a933-359a4d69acfd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:36.105370 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4a0ca5b4-926c-46c2-a933-359a4d69acfd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:36.248992 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-4a0ca5b4-926c-46c2-a933-359a4d69acfd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:36.256781 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-4a0ca5b4-926c-46c2-a933-359a4d69acfd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:36.258278 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-4a0ca5b4-926c-46c2-a933-359a4d69acfd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:36.259435 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-4a0ca5b4-926c-46c2-a933-359a4d69acfd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1722 microversion: 2.20 time: 0.166485 Feb 15 14:30:36.259973 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 378/744] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:30:36 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:30:37.277884 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-6e133475-08ca-47a8-ad96-ba6d06a4a70a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:37.278497 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-6e133475-08ca-47a8-ad96-ba6d06a4a70a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:37.285158 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6e133475-08ca-47a8-ad96-ba6d06a4a70a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:37.285615 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6e133475-08ca-47a8-ad96-ba6d06a4a70a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:37.286400 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6e133475-08ca-47a8-ad96-ba6d06a4a70a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:37.286838 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6e133475-08ca-47a8-ad96-ba6d06a4a70a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:37.504330 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-6e133475-08ca-47a8-ad96-ba6d06a4a70a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:37.513502 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-6e133475-08ca-47a8-ad96-ba6d06a4a70a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:37.515483 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-6e133475-08ca-47a8-ad96-ba6d06a4a70a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:37.516703 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-6e133475-08ca-47a8-ad96-ba6d06a4a70a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1722 microversion: 2.20 time: 0.243274 Feb 15 14:30:37.517266 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 367/745] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:30:37 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:30:38.534947 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-4d1c7c73-8344-4fe3-a9e8-f67c5b2a5818 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:38.535857 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-4d1c7c73-8344-4fe3-a9e8-f67c5b2a5818 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:38.541958 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4d1c7c73-8344-4fe3-a9e8-f67c5b2a5818 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:38.542411 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4d1c7c73-8344-4fe3-a9e8-f67c5b2a5818 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:38.543202 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4d1c7c73-8344-4fe3-a9e8-f67c5b2a5818 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:38.543641 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4d1c7c73-8344-4fe3-a9e8-f67c5b2a5818 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:38.685034 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-4d1c7c73-8344-4fe3-a9e8-f67c5b2a5818 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:38.699373 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-4d1c7c73-8344-4fe3-a9e8-f67c5b2a5818 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:38.700985 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-4d1c7c73-8344-4fe3-a9e8-f67c5b2a5818 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:38.702829 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-4d1c7c73-8344-4fe3-a9e8-f67c5b2a5818 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1722 microversion: 2.20 time: 0.171078 Feb 15 14:30:38.703614 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 379/746] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:30:38 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:30:39.720652 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-007ce47a-cdda-44b9-a8e0-5f206a4275ec tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:39.721419 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-007ce47a-cdda-44b9-a8e0-5f206a4275ec tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:39.727907 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-007ce47a-cdda-44b9-a8e0-5f206a4275ec tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:39.728599 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-007ce47a-cdda-44b9-a8e0-5f206a4275ec tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:39.729948 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-007ce47a-cdda-44b9-a8e0-5f206a4275ec tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:39.730616 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-007ce47a-cdda-44b9-a8e0-5f206a4275ec tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:40.023787 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-007ce47a-cdda-44b9-a8e0-5f206a4275ec tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:40.035410 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-007ce47a-cdda-44b9-a8e0-5f206a4275ec tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:40.036936 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-007ce47a-cdda-44b9-a8e0-5f206a4275ec tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:40.038111 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-007ce47a-cdda-44b9-a8e0-5f206a4275ec tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1722 microversion: 2.20 time: 0.321859 Feb 15 14:30:40.048676 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 368/747] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:30:39 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1722 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:30:41.056000 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-1f5b264a-c1b3-4bfc-a732-b16b9d205714 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:41.056652 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-1f5b264a-c1b3-4bfc-a732-b16b9d205714 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:41.064986 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1f5b264a-c1b3-4bfc-a732-b16b9d205714 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:41.065992 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1f5b264a-c1b3-4bfc-a732-b16b9d205714 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:41.066689 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1f5b264a-c1b3-4bfc-a732-b16b9d205714 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:41.067189 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1f5b264a-c1b3-4bfc-a732-b16b9d205714 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:41.493393 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-1f5b264a-c1b3-4bfc-a732-b16b9d205714 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:41.501489 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-1f5b264a-c1b3-4bfc-a732-b16b9d205714 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:41.503202 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-1f5b264a-c1b3-4bfc-a732-b16b9d205714 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:41.504382 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-1f5b264a-c1b3-4bfc-a732-b16b9d205714 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1722 microversion: 2.20 time: 0.452117 Feb 15 14:30:41.504978 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 380/748] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:30:41 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1722 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:30:42.522369 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-14746353-4ede-4939-ac6d-c9427a395ea0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:42.523126 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-14746353-4ede-4939-ac6d-c9427a395ea0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:42.529654 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-14746353-4ede-4939-ac6d-c9427a395ea0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:42.530760 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-14746353-4ede-4939-ac6d-c9427a395ea0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:42.531509 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-14746353-4ede-4939-ac6d-c9427a395ea0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:42.531948 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-14746353-4ede-4939-ac6d-c9427a395ea0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:42.917043 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-14746353-4ede-4939-ac6d-c9427a395ea0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:42.926087 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-14746353-4ede-4939-ac6d-c9427a395ea0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:42.927685 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-14746353-4ede-4939-ac6d-c9427a395ea0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:42.929042 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-14746353-4ede-4939-ac6d-c9427a395ea0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1722 microversion: 2.20 time: 0.410413 Feb 15 14:30:42.929713 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 369/749] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:30:42 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1722 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:30:43.947417 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-45f72967-2c2d-404d-bb9b-175a94b9a263 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:43.948027 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-45f72967-2c2d-404d-bb9b-175a94b9a263 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:43.955297 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-45f72967-2c2d-404d-bb9b-175a94b9a263 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:43.955747 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-45f72967-2c2d-404d-bb9b-175a94b9a263 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:43.956669 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-45f72967-2c2d-404d-bb9b-175a94b9a263 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:43.957348 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-45f72967-2c2d-404d-bb9b-175a94b9a263 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:44.095257 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-45f72967-2c2d-404d-bb9b-175a94b9a263 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:44.102923 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-45f72967-2c2d-404d-bb9b-175a94b9a263 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:44.104426 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-45f72967-2c2d-404d-bb9b-175a94b9a263 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:44.105564 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-45f72967-2c2d-404d-bb9b-175a94b9a263 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1722 microversion: 2.20 time: 0.162102 Feb 15 14:30:44.106109 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 381/750] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:30:43 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:30:45.126065 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-fdbf7181-ae38-4d53-a4eb-09472077567f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:45.126748 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-fdbf7181-ae38-4d53-a4eb-09472077567f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:45.133221 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fdbf7181-ae38-4d53-a4eb-09472077567f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:45.133621 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fdbf7181-ae38-4d53-a4eb-09472077567f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:45.134408 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fdbf7181-ae38-4d53-a4eb-09472077567f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:45.134850 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fdbf7181-ae38-4d53-a4eb-09472077567f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:45.271257 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-fdbf7181-ae38-4d53-a4eb-09472077567f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:45.279416 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-fdbf7181-ae38-4d53-a4eb-09472077567f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:45.281707 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-fdbf7181-ae38-4d53-a4eb-09472077567f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:45.282872 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-fdbf7181-ae38-4d53-a4eb-09472077567f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1722 microversion: 2.20 time: 0.160697 Feb 15 14:30:45.283433 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 370/751] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:30:45 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:30:46.301545 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-1c1dc67c-df21-44c9-aea1-a8232a6ca6ff tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:46.302177 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-1c1dc67c-df21-44c9-aea1-a8232a6ca6ff tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:46.309074 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1c1dc67c-df21-44c9-aea1-a8232a6ca6ff tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:46.309528 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1c1dc67c-df21-44c9-aea1-a8232a6ca6ff tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:46.310334 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1c1dc67c-df21-44c9-aea1-a8232a6ca6ff tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:46.310809 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1c1dc67c-df21-44c9-aea1-a8232a6ca6ff tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:46.449128 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-1c1dc67c-df21-44c9-aea1-a8232a6ca6ff tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:46.458129 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-1c1dc67c-df21-44c9-aea1-a8232a6ca6ff tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:46.459741 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-1c1dc67c-df21-44c9-aea1-a8232a6ca6ff tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:46.461083 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-1c1dc67c-df21-44c9-aea1-a8232a6ca6ff tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1722 microversion: 2.20 time: 0.163311 Feb 15 14:30:46.461671 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 382/752] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:30:46 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:30:47.479079 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-f6dd1404-00a6-4641-ac4c-b0faaa8c8acf tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:47.479765 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-f6dd1404-00a6-4641-ac4c-b0faaa8c8acf tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:47.487014 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f6dd1404-00a6-4641-ac4c-b0faaa8c8acf tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:47.487466 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f6dd1404-00a6-4641-ac4c-b0faaa8c8acf tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:47.488254 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f6dd1404-00a6-4641-ac4c-b0faaa8c8acf tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:47.488717 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f6dd1404-00a6-4641-ac4c-b0faaa8c8acf tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:47.628280 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-f6dd1404-00a6-4641-ac4c-b0faaa8c8acf tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:47.636909 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-f6dd1404-00a6-4641-ac4c-b0faaa8c8acf tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:47.638436 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-f6dd1404-00a6-4641-ac4c-b0faaa8c8acf tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:47.639767 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-f6dd1404-00a6-4641-ac4c-b0faaa8c8acf tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1722 microversion: 2.20 time: 0.164524 Feb 15 14:30:47.640337 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 371/753] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:30:47 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:30:48.658024 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-8227e9b2-2d45-4cfd-a10e-16f2afbc3720 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:48.658623 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-8227e9b2-2d45-4cfd-a10e-16f2afbc3720 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:48.664911 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8227e9b2-2d45-4cfd-a10e-16f2afbc3720 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:48.665359 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8227e9b2-2d45-4cfd-a10e-16f2afbc3720 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:48.666125 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8227e9b2-2d45-4cfd-a10e-16f2afbc3720 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:48.666552 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8227e9b2-2d45-4cfd-a10e-16f2afbc3720 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:48.805671 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-8227e9b2-2d45-4cfd-a10e-16f2afbc3720 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:48.815431 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-8227e9b2-2d45-4cfd-a10e-16f2afbc3720 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:48.816959 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-8227e9b2-2d45-4cfd-a10e-16f2afbc3720 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:48.820019 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-8227e9b2-2d45-4cfd-a10e-16f2afbc3720 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1722 microversion: 2.20 time: 0.165689 Feb 15 14:30:48.820690 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 383/754] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:30:48 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:30:49.838177 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-66d6d339-e50a-401b-8c79-e81326c285a9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:49.838816 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-66d6d339-e50a-401b-8c79-e81326c285a9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:49.846065 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-66d6d339-e50a-401b-8c79-e81326c285a9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:49.846528 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-66d6d339-e50a-401b-8c79-e81326c285a9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:49.847307 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-66d6d339-e50a-401b-8c79-e81326c285a9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:49.847788 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-66d6d339-e50a-401b-8c79-e81326c285a9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:49.984957 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-66d6d339-e50a-401b-8c79-e81326c285a9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:49.993364 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-66d6d339-e50a-401b-8c79-e81326c285a9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:49.994874 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-66d6d339-e50a-401b-8c79-e81326c285a9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:49.996048 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-66d6d339-e50a-401b-8c79-e81326c285a9 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1722 microversion: 2.20 time: 0.161624 Feb 15 14:30:49.996640 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 372/755] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:30:49 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:30:51.014209 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-994fe16c-7cf3-41b7-9167-411d6b49bb5f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:51.015344 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-994fe16c-7cf3-41b7-9167-411d6b49bb5f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:51.021646 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-994fe16c-7cf3-41b7-9167-411d6b49bb5f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:51.022082 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-994fe16c-7cf3-41b7-9167-411d6b49bb5f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:51.022849 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-994fe16c-7cf3-41b7-9167-411d6b49bb5f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:51.023284 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-994fe16c-7cf3-41b7-9167-411d6b49bb5f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:51.156239 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-994fe16c-7cf3-41b7-9167-411d6b49bb5f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:51.163931 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-994fe16c-7cf3-41b7-9167-411d6b49bb5f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:51.165443 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-994fe16c-7cf3-41b7-9167-411d6b49bb5f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:51.166586 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-994fe16c-7cf3-41b7-9167-411d6b49bb5f tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1722 microversion: 2.20 time: 0.156079 Feb 15 14:30:51.167134 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 384/756] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:30:51 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:30:52.184894 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-8069baad-388a-4073-8fe7-b7d1ed2474ae tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:52.185422 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-8069baad-388a-4073-8fe7-b7d1ed2474ae tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:52.192441 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8069baad-388a-4073-8fe7-b7d1ed2474ae tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:52.192895 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8069baad-388a-4073-8fe7-b7d1ed2474ae tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:52.193676 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8069baad-388a-4073-8fe7-b7d1ed2474ae tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:52.194107 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8069baad-388a-4073-8fe7-b7d1ed2474ae tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:52.325135 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-8069baad-388a-4073-8fe7-b7d1ed2474ae tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:52.333063 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-8069baad-388a-4073-8fe7-b7d1ed2474ae tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:52.334562 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-8069baad-388a-4073-8fe7-b7d1ed2474ae tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:52.335723 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-8069baad-388a-4073-8fe7-b7d1ed2474ae tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1743 microversion: 2.20 time: 0.154602 Feb 15 14:30:52.336280 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 373/757] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:30:52 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:30:53.354541 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-ef8e5f0e-3b46-4db5-bc38-e8d9a1e63720 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:53.355178 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-ef8e5f0e-3b46-4db5-bc38-e8d9a1e63720 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:53.362352 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ef8e5f0e-3b46-4db5-bc38-e8d9a1e63720 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:53.362808 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ef8e5f0e-3b46-4db5-bc38-e8d9a1e63720 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:53.363595 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ef8e5f0e-3b46-4db5-bc38-e8d9a1e63720 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:53.364035 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ef8e5f0e-3b46-4db5-bc38-e8d9a1e63720 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:53.494051 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-ef8e5f0e-3b46-4db5-bc38-e8d9a1e63720 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:53.501866 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-ef8e5f0e-3b46-4db5-bc38-e8d9a1e63720 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:53.503353 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-ef8e5f0e-3b46-4db5-bc38-e8d9a1e63720 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:53.504524 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-ef8e5f0e-3b46-4db5-bc38-e8d9a1e63720 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1743 microversion: 2.20 time: 0.153761 Feb 15 14:30:53.505072 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 385/758] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:30:53 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:30:54.522124 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-4bb195ff-1fbd-4bf8-9f35-797e9c7eafc8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:54.523014 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-4bb195ff-1fbd-4bf8-9f35-797e9c7eafc8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:54.529167 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4bb195ff-1fbd-4bf8-9f35-797e9c7eafc8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:54.529619 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4bb195ff-1fbd-4bf8-9f35-797e9c7eafc8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:54.530394 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4bb195ff-1fbd-4bf8-9f35-797e9c7eafc8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:54.530834 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4bb195ff-1fbd-4bf8-9f35-797e9c7eafc8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:54.675282 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-4bb195ff-1fbd-4bf8-9f35-797e9c7eafc8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:54.683452 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-4bb195ff-1fbd-4bf8-9f35-797e9c7eafc8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:54.685007 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-4bb195ff-1fbd-4bf8-9f35-797e9c7eafc8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:54.686448 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-4bb195ff-1fbd-4bf8-9f35-797e9c7eafc8 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1738 microversion: 2.20 time: 0.168051 Feb 15 14:30:54.687744 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 374/759] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:30:54 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:30:55.706625 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-95e839fa-15d0-42bf-a5e5-392ca4b7c257 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:55.707573 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-95e839fa-15d0-42bf-a5e5-392ca4b7c257 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:55.713898 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-95e839fa-15d0-42bf-a5e5-392ca4b7c257 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:55.714649 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-95e839fa-15d0-42bf-a5e5-392ca4b7c257 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:55.715760 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-95e839fa-15d0-42bf-a5e5-392ca4b7c257 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:55.716207 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-95e839fa-15d0-42bf-a5e5-392ca4b7c257 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:55.879133 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-95e839fa-15d0-42bf-a5e5-392ca4b7c257 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:55.887311 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-95e839fa-15d0-42bf-a5e5-392ca4b7c257 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:55.889790 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-95e839fa-15d0-42bf-a5e5-392ca4b7c257 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:55.890987 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-95e839fa-15d0-42bf-a5e5-392ca4b7c257 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1738 microversion: 2.20 time: 0.189026 Feb 15 14:30:55.897290 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 386/760] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:30:55 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:30:56.909655 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-21dc2d86-b688-4031-ab6d-b70a83df0917 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:56.910327 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-21dc2d86-b688-4031-ab6d-b70a83df0917 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:56.917184 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-21dc2d86-b688-4031-ab6d-b70a83df0917 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:56.917638 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-21dc2d86-b688-4031-ab6d-b70a83df0917 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:56.918424 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-21dc2d86-b688-4031-ab6d-b70a83df0917 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:56.918866 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-21dc2d86-b688-4031-ab6d-b70a83df0917 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:57.063096 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-21dc2d86-b688-4031-ab6d-b70a83df0917 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:57.071804 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-21dc2d86-b688-4031-ab6d-b70a83df0917 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:57.073345 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-21dc2d86-b688-4031-ab6d-b70a83df0917 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:57.074561 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-21dc2d86-b688-4031-ab6d-b70a83df0917 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1738 microversion: 2.20 time: 0.169134 Feb 15 14:30:57.075422 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 375/761] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:30:56 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:30:57.446460 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-b5e46422-0b05-46d3-b1bf-a3ec5a04e56f req-fa1bb412-0443-45a3-9c44-79baa3f0f44a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1deaae9b-7503-48ca-a476-5814a26e51e0", "name": "network-vif-plugged", "status": "completed", "tag": "9bcff6b8-b07d-43be-bb6c-2f956f455705"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:30:57.448672 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:30:57.448672 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:30:57.462385 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-b5e46422-0b05-46d3-b1bf-a3ec5a04e56f req-fa1bb412-0443-45a3-9c44-79baa3f0f44a service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:57.463072 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-b5e46422-0b05-46d3-b1bf-a3ec5a04e56f req-fa1bb412-0443-45a3-9c44-79baa3f0f44a service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:57.474636 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-b5e46422-0b05-46d3-b1bf-a3ec5a04e56f req-fa1bb412-0443-45a3-9c44-79baa3f0f44a service nova] Creating event network-vif-plugged:9bcff6b8-b07d-43be-bb6c-2f956f455705 for instance 1deaae9b-7503-48ca-a476-5814a26e51e0 on hv-cinder-81914 Feb 15 14:30:57.479661 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-b5e46422-0b05-46d3-b1bf-a3ec5a04e56f req-fa1bb412-0443-45a3-9c44-79baa3f0f44a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214816 Feb 15 14:30:57.480248 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 387/762] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:30:58.093889 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-0bb970e8-b993-4e02-8b0a-ad6cfa2b5dcc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:58.095823 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-0bb970e8-b993-4e02-8b0a-ad6cfa2b5dcc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:58.108178 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0bb970e8-b993-4e02-8b0a-ad6cfa2b5dcc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:58.109372 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0bb970e8-b993-4e02-8b0a-ad6cfa2b5dcc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:58.110537 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0bb970e8-b993-4e02-8b0a-ad6cfa2b5dcc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:58.111202 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0bb970e8-b993-4e02-8b0a-ad6cfa2b5dcc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:58.264158 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-0bb970e8-b993-4e02-8b0a-ad6cfa2b5dcc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:58.272280 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-0bb970e8-b993-4e02-8b0a-ad6cfa2b5dcc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:58.273826 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-0bb970e8-b993-4e02-8b0a-ad6cfa2b5dcc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:58.275206 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-0bb970e8-b993-4e02-8b0a-ad6cfa2b5dcc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1738 microversion: 2.20 time: 0.185629 Feb 15 14:30:58.276255 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 376/763] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:30:58 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:30:59.295578 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-a00cfcb9-1f37-4737-ab1e-bbff14b3c4a6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:30:59.297577 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-a00cfcb9-1f37-4737-ab1e-bbff14b3c4a6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:30:59.304206 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a00cfcb9-1f37-4737-ab1e-bbff14b3c4a6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:59.304971 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a00cfcb9-1f37-4737-ab1e-bbff14b3c4a6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:59.306095 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a00cfcb9-1f37-4737-ab1e-bbff14b3c4a6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:30:59.306783 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a00cfcb9-1f37-4737-ab1e-bbff14b3c4a6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:30:59.457646 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a00cfcb9-1f37-4737-ab1e-bbff14b3c4a6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:59.469327 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a00cfcb9-1f37-4737-ab1e-bbff14b3c4a6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:59.471026 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a00cfcb9-1f37-4737-ab1e-bbff14b3c4a6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:30:59.472217 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-a00cfcb9-1f37-4737-ab1e-bbff14b3c4a6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1738 microversion: 2.20 time: 0.182530 Feb 15 14:30:59.472805 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 388/764] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:30:59 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:31:00.490709 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-fab7be3a-4bcd-4893-a6c2-3e6732dda48c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:00.491417 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-fab7be3a-4bcd-4893-a6c2-3e6732dda48c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:00.497962 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fab7be3a-4bcd-4893-a6c2-3e6732dda48c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:00.498543 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fab7be3a-4bcd-4893-a6c2-3e6732dda48c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:00.510126 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fab7be3a-4bcd-4893-a6c2-3e6732dda48c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:00.510867 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fab7be3a-4bcd-4893-a6c2-3e6732dda48c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:00.655027 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-fab7be3a-4bcd-4893-a6c2-3e6732dda48c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:00.663795 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-fab7be3a-4bcd-4893-a6c2-3e6732dda48c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:00.665470 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-fab7be3a-4bcd-4893-a6c2-3e6732dda48c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:00.666700 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-fab7be3a-4bcd-4893-a6c2-3e6732dda48c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1738 microversion: 2.20 time: 0.180269 Feb 15 14:31:00.679029 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 377/765] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:31:00 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:31:01.686582 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-1f3aca83-1eb7-46d3-85c7-cb002229a195 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:01.687307 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-1f3aca83-1eb7-46d3-85c7-cb002229a195 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:01.694144 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1f3aca83-1eb7-46d3-85c7-cb002229a195 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:01.694627 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1f3aca83-1eb7-46d3-85c7-cb002229a195 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:01.695416 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1f3aca83-1eb7-46d3-85c7-cb002229a195 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:01.695860 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1f3aca83-1eb7-46d3-85c7-cb002229a195 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:01.779388 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-a9f167f9-00db-49d5-9ab4-62d55bdbbb71 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:01.781371 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-a9f167f9-00db-49d5-9ab4-62d55bdbbb71 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:01.788120 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a9f167f9-00db-49d5-9ab4-62d55bdbbb71 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:01.788638 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a9f167f9-00db-49d5-9ab4-62d55bdbbb71 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:01.789414 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a9f167f9-00db-49d5-9ab4-62d55bdbbb71 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:01.789854 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a9f167f9-00db-49d5-9ab4-62d55bdbbb71 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:01.846469 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-1f3aca83-1eb7-46d3-85c7-cb002229a195 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:01.855992 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-1f3aca83-1eb7-46d3-85c7-cb002229a195 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:01.857844 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-1f3aca83-1eb7-46d3-85c7-cb002229a195 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:01.860856 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-1f3aca83-1eb7-46d3-85c7-cb002229a195 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1738 microversion: 2.20 time: 0.178035 Feb 15 14:31:01.872511 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 389/766] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:31:01 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:31:01.890987 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.objects.instance [None req-a9f167f9-00db-49d5-9ab4-62d55bdbbb71 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lazy-loading 'services' on Instance uuid db561480-36d5-4879-aa89-d62bf3623851 {{(pid=116362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:31:01.970831 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-a9f167f9-00db-49d5-9ab4-62d55bdbbb71 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "DELETE /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851/os-volume_attachments/278ef4ed-75e8-42c3-8806-8835a154efa0" status: 202 len: 0 microversion: 2.1 time: 0.196354 Feb 15 14:31:01.971712 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 378/767] 10.222.0.83 () {58 vars in 1415 bytes} [Tue Feb 15 14:31:01 2022] DELETE /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851/os-volume_attachments/278ef4ed-75e8-42c3-8806-8835a154efa0 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:31:02.883830 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-424cf5d1-1ab1-45e7-9a3c-2957ca7ae781 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:02.884590 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-424cf5d1-1ab1-45e7-9a3c-2957ca7ae781 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:02.891550 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-424cf5d1-1ab1-45e7-9a3c-2957ca7ae781 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:02.892294 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-424cf5d1-1ab1-45e7-9a3c-2957ca7ae781 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:02.893403 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-424cf5d1-1ab1-45e7-9a3c-2957ca7ae781 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:02.894044 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-424cf5d1-1ab1-45e7-9a3c-2957ca7ae781 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:03.063895 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-424cf5d1-1ab1-45e7-9a3c-2957ca7ae781 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:03.072052 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-424cf5d1-1ab1-45e7-9a3c-2957ca7ae781 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:03.073602 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-424cf5d1-1ab1-45e7-9a3c-2957ca7ae781 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:03.074776 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-424cf5d1-1ab1-45e7-9a3c-2957ca7ae781 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1738 microversion: 2.20 time: 0.198883 Feb 15 14:31:03.086213 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 390/768] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:31:02 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:31:03.115085 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-a4a155d3-893c-4836-943f-665b1c7172ac tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:31:03.121870 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a4a155d3-893c-4836-943f-665b1c7172ac tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:03.122330 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a4a155d3-893c-4836-943f-665b1c7172ac tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:03.146399 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-a4a155d3-893c-4836-943f-665b1c7172ac tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Going to try to stop instance {{(pid=116362) force_stop /opt/stack/nova/nova/compute/api.py:2674}} Feb 15 14:31:03.188991 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-a4a155d3-893c-4836-943f-665b1c7172ac tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "POST /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851/action" status: 202 len: 0 microversion: 2.1 time: 0.077863 Feb 15 14:31:03.190690 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 379/769] 10.222.0.83 () {60 vars in 1277 bytes} [Tue Feb 15 14:31:03 2022] POST /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:31:03.198432 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-7d152355-0254-4937-a5db-5e43b54ea1ea tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:03.199107 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-7d152355-0254-4937-a5db-5e43b54ea1ea tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:03.208717 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7d152355-0254-4937-a5db-5e43b54ea1ea tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:03.209171 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7d152355-0254-4937-a5db-5e43b54ea1ea tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:03.209965 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7d152355-0254-4937-a5db-5e43b54ea1ea tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:03.210407 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7d152355-0254-4937-a5db-5e43b54ea1ea tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:03.342497 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-7d152355-0254-4937-a5db-5e43b54ea1ea tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:03.349935 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-7d152355-0254-4937-a5db-5e43b54ea1ea tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1676 microversion: 2.1 time: 0.155716 Feb 15 14:31:03.350495 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 391/770] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:31:03 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:31:04.093269 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-7a48e93b-5ea1-43a0-961d-b9ab2abd98bc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:04.093967 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-7a48e93b-5ea1-43a0-961d-b9ab2abd98bc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:04.100016 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7a48e93b-5ea1-43a0-961d-b9ab2abd98bc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:04.100494 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7a48e93b-5ea1-43a0-961d-b9ab2abd98bc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:04.101346 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7a48e93b-5ea1-43a0-961d-b9ab2abd98bc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:04.101723 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7a48e93b-5ea1-43a0-961d-b9ab2abd98bc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:04.241196 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-7a48e93b-5ea1-43a0-961d-b9ab2abd98bc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:04.249858 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-7a48e93b-5ea1-43a0-961d-b9ab2abd98bc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:04.251342 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-7a48e93b-5ea1-43a0-961d-b9ab2abd98bc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:04.252580 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-7a48e93b-5ea1-43a0-961d-b9ab2abd98bc tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1720 microversion: 2.20 time: 0.163417 Feb 15 14:31:04.253141 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 380/771] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:31:04 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:31:04.367144 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-23479dda-6068-438e-9acd-6dfd1db4312c tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:04.367662 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-23479dda-6068-438e-9acd-6dfd1db4312c tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:04.374587 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-23479dda-6068-438e-9acd-6dfd1db4312c tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:04.375031 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-23479dda-6068-438e-9acd-6dfd1db4312c tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:04.375803 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-23479dda-6068-438e-9acd-6dfd1db4312c tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:04.376240 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-23479dda-6068-438e-9acd-6dfd1db4312c tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:04.509662 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-23479dda-6068-438e-9acd-6dfd1db4312c tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:04.517261 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-23479dda-6068-438e-9acd-6dfd1db4312c tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1676 microversion: 2.1 time: 0.153902 Feb 15 14:31:04.517835 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 392/772] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:31:04 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:31:05.271030 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-a838248c-86b9-48f7-9689-487d9b22149c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:05.271544 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-a838248c-86b9-48f7-9689-487d9b22149c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:05.277995 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a838248c-86b9-48f7-9689-487d9b22149c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:05.278440 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a838248c-86b9-48f7-9689-487d9b22149c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:05.279204 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a838248c-86b9-48f7-9689-487d9b22149c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:05.279636 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a838248c-86b9-48f7-9689-487d9b22149c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:05.410362 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-a838248c-86b9-48f7-9689-487d9b22149c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:05.418089 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-a838248c-86b9-48f7-9689-487d9b22149c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:05.419631 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-a838248c-86b9-48f7-9689-487d9b22149c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:05.420926 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-a838248c-86b9-48f7-9689-487d9b22149c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1720 microversion: 2.20 time: 0.153642 Feb 15 14:31:05.421489 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 381/773] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:31:05 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:31:05.534013 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-25b5c451-9866-492b-ba0a-d84bf265f38c tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:05.534553 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-25b5c451-9866-492b-ba0a-d84bf265f38c tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:05.540849 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-25b5c451-9866-492b-ba0a-d84bf265f38c tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:05.541301 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-25b5c451-9866-492b-ba0a-d84bf265f38c tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:05.542077 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-25b5c451-9866-492b-ba0a-d84bf265f38c tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:05.542514 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-25b5c451-9866-492b-ba0a-d84bf265f38c tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:05.671540 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-25b5c451-9866-492b-ba0a-d84bf265f38c tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:05.679040 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-25b5c451-9866-492b-ba0a-d84bf265f38c tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1676 microversion: 2.1 time: 0.149029 Feb 15 14:31:05.679609 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 393/774] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:31:05 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:31:06.439971 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-3ee06b1a-35c7-4843-a407-658c68ad8310 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:06.440875 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-3ee06b1a-35c7-4843-a407-658c68ad8310 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:06.447153 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3ee06b1a-35c7-4843-a407-658c68ad8310 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:06.447605 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3ee06b1a-35c7-4843-a407-658c68ad8310 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:06.449035 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3ee06b1a-35c7-4843-a407-658c68ad8310 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:06.449649 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3ee06b1a-35c7-4843-a407-658c68ad8310 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:06.587523 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-3ee06b1a-35c7-4843-a407-658c68ad8310 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:06.595576 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-3ee06b1a-35c7-4843-a407-658c68ad8310 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:06.597118 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-3ee06b1a-35c7-4843-a407-658c68ad8310 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:06.598281 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-3ee06b1a-35c7-4843-a407-658c68ad8310 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1723 microversion: 2.20 time: 0.163084 Feb 15 14:31:06.598853 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 382/775] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:31:06 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 14:31:06.616118 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-1725f284-d27a-4453-8596-2ec270aa9a88 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8614fd48-d4ac-430a-9201-e8fad8b95ab6"}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:31:06.617249 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-1725f284-d27a-4453-8596-2ec270aa9a88 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:06.624085 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1725f284-d27a-4453-8596-2ec270aa9a88 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:06.624580 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1725f284-d27a-4453-8596-2ec270aa9a88 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:06.625354 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1725f284-d27a-4453-8596-2ec270aa9a88 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:06.625791 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1725f284-d27a-4453-8596-2ec270aa9a88 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:06.696767 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-def01db7-8a46-4c30-aa6c-d70a5c36057f tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:06.697575 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-def01db7-8a46-4c30-aa6c-d70a5c36057f tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:06.703696 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-def01db7-8a46-4c30-aa6c-d70a5c36057f tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:06.704137 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-def01db7-8a46-4c30-aa6c-d70a5c36057f tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:06.704983 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-def01db7-8a46-4c30-aa6c-d70a5c36057f tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:06.705420 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-def01db7-8a46-4c30-aa6c-d70a5c36057f tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:06.850265 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-def01db7-8a46-4c30-aa6c-d70a5c36057f tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:06.858980 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-def01db7-8a46-4c30-aa6c-d70a5c36057f tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1676 microversion: 2.1 time: 0.165833 Feb 15 14:31:06.859717 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 383/776] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:31:06 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:31:06.909584 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-1725f284-d27a-4453-8596-2ec270aa9a88 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "POST /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.297081 Feb 15 14:31:06.910200 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 394/777] 10.222.0.83 () {62 vars in 1363 bytes} [Tue Feb 15 14:31:06 2022] POST /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0/os-volume_attachments => generated 188 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 14:31:07.018230 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-352c23b2-3add-4c5f-b1ac-f1f0196943b7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:07.018724 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-352c23b2-3add-4c5f-b1ac-f1f0196943b7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:07.024845 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-352c23b2-3add-4c5f-b1ac-f1f0196943b7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:07.025297 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-352c23b2-3add-4c5f-b1ac-f1f0196943b7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:07.026069 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-352c23b2-3add-4c5f-b1ac-f1f0196943b7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:07.026509 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-352c23b2-3add-4c5f-b1ac-f1f0196943b7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:07.225618 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-254077c0-7d0e-4e3f-8142-ea1e3db9c365 req-77c3f54d-b806-4198-9cef-2cbbd43cf408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1deaae9b-7503-48ca-a476-5814a26e51e0", "name": "network-vif-unplugged", "status": "completed", "tag": "9bcff6b8-b07d-43be-bb6c-2f956f455705"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:31:07.227606 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:31:07.227606 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:31:07.236041 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-254077c0-7d0e-4e3f-8142-ea1e3db9c365 req-77c3f54d-b806-4198-9cef-2cbbd43cf408 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:07.236532 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-254077c0-7d0e-4e3f-8142-ea1e3db9c365 req-77c3f54d-b806-4198-9cef-2cbbd43cf408 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:07.245853 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-352c23b2-3add-4c5f-b1ac-f1f0196943b7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "DELETE /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0/os-volume_attachments/8614fd48-d4ac-430a-9201-e8fad8b95ab6" status: 202 len: 0 microversion: 2.20 time: 0.231462 Feb 15 14:31:07.246912 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 384/778] 10.222.0.83 () {60 vars in 1456 bytes} [Tue Feb 15 14:31:07 2022] DELETE /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0/os-volume_attachments/8614fd48-d4ac-430a-9201-e8fad8b95ab6 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 15 14:31:07.251958 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.compute.server_external_events [req-254077c0-7d0e-4e3f-8142-ea1e3db9c365 req-77c3f54d-b806-4198-9cef-2cbbd43cf408 service nova] Unable to find a host for instance 1deaae9b-7503-48ca-a476-5814a26e51e0. Dropping event network-vif-unplugged {{(pid=116363) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 15 14:31:07.252886 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-254077c0-7d0e-4e3f-8142-ea1e3db9c365 req-77c3f54d-b806-4198-9cef-2cbbd43cf408 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031031 Feb 15 14:31:07.253477 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 395/779] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 15 14:31:07.303010 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-ea295826-271c-4542-87b2-04c1838cedba tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:31:07.303569 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-ea295826-271c-4542-87b2-04c1838cedba tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:07.309427 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ea295826-271c-4542-87b2-04c1838cedba tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:07.309891 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ea295826-271c-4542-87b2-04c1838cedba tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:07.310717 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ea295826-271c-4542-87b2-04c1838cedba tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:07.311135 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ea295826-271c-4542-87b2-04c1838cedba tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:07.385310 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-ea295826-271c-4542-87b2-04c1838cedba tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "POST /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0/action" status: 202 len: 0 microversion: 2.20 time: 0.086002 Feb 15 14:31:07.385910 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 385/780] 10.222.0.83 () {62 vars in 1318 bytes} [Tue Feb 15 14:31:07 2022] POST /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 15 14:31:07.394347 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-7f3772af-899e-4f3b-95a8-6f4ec5fd7e80 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:07.395071 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-7f3772af-899e-4f3b-95a8-6f4ec5fd7e80 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:07.401340 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7f3772af-899e-4f3b-95a8-6f4ec5fd7e80 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:07.401865 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7f3772af-899e-4f3b-95a8-6f4ec5fd7e80 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:07.402702 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7f3772af-899e-4f3b-95a8-6f4ec5fd7e80 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:07.403213 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7f3772af-899e-4f3b-95a8-6f4ec5fd7e80 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:07.538803 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-7f3772af-899e-4f3b-95a8-6f4ec5fd7e80 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:07.546938 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-7f3772af-899e-4f3b-95a8-6f4ec5fd7e80 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:07.548472 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-7f3772af-899e-4f3b-95a8-6f4ec5fd7e80 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:07.549645 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-7f3772af-899e-4f3b-95a8-6f4ec5fd7e80 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1671 microversion: 2.20 time: 0.159083 Feb 15 14:31:07.550288 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 396/781] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:31:07 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 14:31:07.876975 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-b00c3c63-637a-481f-8d80-81ca385ab4c0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:07.878168 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-b00c3c63-637a-481f-8d80-81ca385ab4c0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:07.885201 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b00c3c63-637a-481f-8d80-81ca385ab4c0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:07.885657 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b00c3c63-637a-481f-8d80-81ca385ab4c0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:07.886444 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b00c3c63-637a-481f-8d80-81ca385ab4c0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:07.886919 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b00c3c63-637a-481f-8d80-81ca385ab4c0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:08.028748 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-b00c3c63-637a-481f-8d80-81ca385ab4c0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:08.036338 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-b00c3c63-637a-481f-8d80-81ca385ab4c0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1676 microversion: 2.1 time: 0.163884 Feb 15 14:31:08.036950 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 386/782] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:31:07 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:31:08.567464 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-81e4e559-2403-45c9-93d9-164d93f1df8c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:08.568037 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-81e4e559-2403-45c9-93d9-164d93f1df8c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:08.574410 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-81e4e559-2403-45c9-93d9-164d93f1df8c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:08.574992 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-81e4e559-2403-45c9-93d9-164d93f1df8c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:08.575688 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-81e4e559-2403-45c9-93d9-164d93f1df8c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:08.576121 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-81e4e559-2403-45c9-93d9-164d93f1df8c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:08.796729 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-81e4e559-2403-45c9-93d9-164d93f1df8c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:08.804367 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-81e4e559-2403-45c9-93d9-164d93f1df8c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:08.805896 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-81e4e559-2403-45c9-93d9-164d93f1df8c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:08.807051 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-81e4e559-2403-45c9-93d9-164d93f1df8c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1729 microversion: 2.20 time: 0.243402 Feb 15 14:31:08.807632 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 397/783] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:31:08 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1729 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:31:09.053565 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-9ce02dd0-b9cf-40dd-aa77-e7a102452651 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:09.054170 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-9ce02dd0-b9cf-40dd-aa77-e7a102452651 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:09.060326 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9ce02dd0-b9cf-40dd-aa77-e7a102452651 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:09.061388 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9ce02dd0-b9cf-40dd-aa77-e7a102452651 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:09.062364 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9ce02dd0-b9cf-40dd-aa77-e7a102452651 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:09.062799 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9ce02dd0-b9cf-40dd-aa77-e7a102452651 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:09.196301 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-9ce02dd0-b9cf-40dd-aa77-e7a102452651 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:09.204064 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-9ce02dd0-b9cf-40dd-aa77-e7a102452651 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1676 microversion: 2.1 time: 0.154087 Feb 15 14:31:09.204780 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 387/784] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:31:09 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:31:09.826844 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-0e91670a-806c-47cf-8ec6-431e04e5756b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:09.827608 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-0e91670a-806c-47cf-8ec6-431e04e5756b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:09.833942 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0e91670a-806c-47cf-8ec6-431e04e5756b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:09.834472 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0e91670a-806c-47cf-8ec6-431e04e5756b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:09.835334 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0e91670a-806c-47cf-8ec6-431e04e5756b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:09.835850 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0e91670a-806c-47cf-8ec6-431e04e5756b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:09.977582 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-0e91670a-806c-47cf-8ec6-431e04e5756b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:09.986364 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-0e91670a-806c-47cf-8ec6-431e04e5756b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:09.987956 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-0e91670a-806c-47cf-8ec6-431e04e5756b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:09.989246 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-0e91670a-806c-47cf-8ec6-431e04e5756b tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1729 microversion: 2.20 time: 0.166702 Feb 15 14:31:09.994005 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 398/785] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:31:09 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:31:10.221717 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-54b58098-0f42-4fc5-9018-c58fed6248ca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:10.222333 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-54b58098-0f42-4fc5-9018-c58fed6248ca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:10.229017 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-54b58098-0f42-4fc5-9018-c58fed6248ca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:10.229471 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-54b58098-0f42-4fc5-9018-c58fed6248ca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:10.230264 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-54b58098-0f42-4fc5-9018-c58fed6248ca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:10.235156 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-54b58098-0f42-4fc5-9018-c58fed6248ca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:10.383726 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-54b58098-0f42-4fc5-9018-c58fed6248ca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:10.391934 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-54b58098-0f42-4fc5-9018-c58fed6248ca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1676 microversion: 2.1 time: 0.174436 Feb 15 14:31:10.392532 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 388/786] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:31:10 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:31:11.007552 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-a12394d6-cf30-433b-a761-373685380f07 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:11.008202 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-a12394d6-cf30-433b-a761-373685380f07 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:11.015104 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a12394d6-cf30-433b-a761-373685380f07 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:11.015557 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a12394d6-cf30-433b-a761-373685380f07 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:11.016347 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a12394d6-cf30-433b-a761-373685380f07 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:11.016815 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a12394d6-cf30-433b-a761-373685380f07 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:11.399583 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a12394d6-cf30-433b-a761-373685380f07 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:11.410127 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-cd5fc0e3-3fc6-4a6c-a8fc-71489b62a5b7 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:11.410874 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-cd5fc0e3-3fc6-4a6c-a8fc-71489b62a5b7 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:11.416967 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a12394d6-cf30-433b-a761-373685380f07 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:11.417161 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cd5fc0e3-3fc6-4a6c-a8fc-71489b62a5b7 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:11.417609 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cd5fc0e3-3fc6-4a6c-a8fc-71489b62a5b7 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:11.418391 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cd5fc0e3-3fc6-4a6c-a8fc-71489b62a5b7 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:11.418498 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a12394d6-cf30-433b-a761-373685380f07 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:11.418820 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cd5fc0e3-3fc6-4a6c-a8fc-71489b62a5b7 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:11.419681 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-a12394d6-cf30-433b-a761-373685380f07 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1729 microversion: 2.20 time: 0.416310 Feb 15 14:31:11.420494 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 399/787] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:31:11 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1729 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:31:11.556338 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-cd5fc0e3-3fc6-4a6c-a8fc-71489b62a5b7 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:11.564923 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-cd5fc0e3-3fc6-4a6c-a8fc-71489b62a5b7 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1676 microversion: 2.1 time: 0.158376 Feb 15 14:31:11.565507 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 389/788] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:31:11 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:31:12.437196 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-5ff3f90d-b22b-4606-8724-41e5a4cee080 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:12.437797 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-5ff3f90d-b22b-4606-8724-41e5a4cee080 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:12.444178 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5ff3f90d-b22b-4606-8724-41e5a4cee080 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:12.444658 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5ff3f90d-b22b-4606-8724-41e5a4cee080 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:12.445443 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5ff3f90d-b22b-4606-8724-41e5a4cee080 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:12.445875 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5ff3f90d-b22b-4606-8724-41e5a4cee080 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:12.582603 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-8b9d7ff9-327a-413c-af19-56b553a31c82 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:12.583223 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-8b9d7ff9-327a-413c-af19-56b553a31c82 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:12.586931 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-5ff3f90d-b22b-4606-8724-41e5a4cee080 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:12.591433 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8b9d7ff9-327a-413c-af19-56b553a31c82 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:12.592574 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8b9d7ff9-327a-413c-af19-56b553a31c82 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:12.593834 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8b9d7ff9-327a-413c-af19-56b553a31c82 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:12.594286 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-8b9d7ff9-327a-413c-af19-56b553a31c82 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:12.596004 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-5ff3f90d-b22b-4606-8724-41e5a4cee080 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:12.597531 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-5ff3f90d-b22b-4606-8724-41e5a4cee080 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:12.598692 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-5ff3f90d-b22b-4606-8724-41e5a4cee080 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1729 microversion: 2.20 time: 0.165257 Feb 15 14:31:12.599450 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 400/789] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:31:12 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:31:12.751645 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-8b9d7ff9-327a-413c-af19-56b553a31c82 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:12.759600 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-8b9d7ff9-327a-413c-af19-56b553a31c82 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1676 microversion: 2.1 time: 0.180648 Feb 15 14:31:12.760181 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 390/790] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:31:12 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:31:13.618579 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-a738722f-e2e8-487e-b305-2daecd7a8a86 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:13.619226 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-a738722f-e2e8-487e-b305-2daecd7a8a86 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:13.626016 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a738722f-e2e8-487e-b305-2daecd7a8a86 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:13.626462 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a738722f-e2e8-487e-b305-2daecd7a8a86 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:13.627246 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a738722f-e2e8-487e-b305-2daecd7a8a86 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:13.629550 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a738722f-e2e8-487e-b305-2daecd7a8a86 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:13.773001 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a738722f-e2e8-487e-b305-2daecd7a8a86 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:13.778109 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-6370a0fa-4dfa-44ac-a181-1021ad7452bf tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:13.778757 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-6370a0fa-4dfa-44ac-a181-1021ad7452bf tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:13.784661 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a738722f-e2e8-487e-b305-2daecd7a8a86 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:13.786303 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6370a0fa-4dfa-44ac-a181-1021ad7452bf tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:13.786423 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a738722f-e2e8-487e-b305-2daecd7a8a86 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:13.786758 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6370a0fa-4dfa-44ac-a181-1021ad7452bf tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:13.787554 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6370a0fa-4dfa-44ac-a181-1021ad7452bf tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:13.787779 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-a738722f-e2e8-487e-b305-2daecd7a8a86 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1729 microversion: 2.20 time: 0.172831 Feb 15 14:31:13.787986 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6370a0fa-4dfa-44ac-a181-1021ad7452bf tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:13.792453 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 401/791] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:31:13 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:31:13.939820 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-6370a0fa-4dfa-44ac-a181-1021ad7452bf tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:13.947782 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-6370a0fa-4dfa-44ac-a181-1021ad7452bf tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1676 microversion: 2.1 time: 0.174520 Feb 15 14:31:13.948512 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 391/792] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:31:13 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:31:14.806688 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-8735c146-67b2-45fd-af27-0fa616360fd7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:14.807316 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-8735c146-67b2-45fd-af27-0fa616360fd7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:14.815311 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8735c146-67b2-45fd-af27-0fa616360fd7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:14.815764 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8735c146-67b2-45fd-af27-0fa616360fd7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:14.816599 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8735c146-67b2-45fd-af27-0fa616360fd7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:14.817041 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-8735c146-67b2-45fd-af27-0fa616360fd7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:14.965052 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-31ce9d7b-16bb-4369-ad8f-482a43fae5fa tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:14.966030 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-31ce9d7b-16bb-4369-ad8f-482a43fae5fa tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:14.968000 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-8735c146-67b2-45fd-af27-0fa616360fd7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:14.974436 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-31ce9d7b-16bb-4369-ad8f-482a43fae5fa tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:14.974890 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-31ce9d7b-16bb-4369-ad8f-482a43fae5fa tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:14.975682 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-31ce9d7b-16bb-4369-ad8f-482a43fae5fa tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:14.976119 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-31ce9d7b-16bb-4369-ad8f-482a43fae5fa tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:14.976242 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-8735c146-67b2-45fd-af27-0fa616360fd7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:14.977731 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-8735c146-67b2-45fd-af27-0fa616360fd7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:14.978890 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-8735c146-67b2-45fd-af27-0fa616360fd7 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1729 microversion: 2.20 time: 0.176009 Feb 15 14:31:14.979664 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 402/793] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:31:14 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:31:15.121039 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-31ce9d7b-16bb-4369-ad8f-482a43fae5fa tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:15.130172 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-31ce9d7b-16bb-4369-ad8f-482a43fae5fa tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1676 microversion: 2.1 time: 0.168940 Feb 15 14:31:15.130868 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 392/794] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:31:14 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:31:15.996564 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-03d7d562-14ff-4e9e-91f0-5a70b7b8271d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:15.997149 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-03d7d562-14ff-4e9e-91f0-5a70b7b8271d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:16.004246 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-03d7d562-14ff-4e9e-91f0-5a70b7b8271d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:16.004728 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-03d7d562-14ff-4e9e-91f0-5a70b7b8271d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:16.005512 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-03d7d562-14ff-4e9e-91f0-5a70b7b8271d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:16.005943 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-03d7d562-14ff-4e9e-91f0-5a70b7b8271d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:16.150444 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-5fbe378a-8c7a-47eb-b800-26a6fd335cf2 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:16.151856 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-5fbe378a-8c7a-47eb-b800-26a6fd335cf2 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:16.159334 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-03d7d562-14ff-4e9e-91f0-5a70b7b8271d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:16.159544 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5fbe378a-8c7a-47eb-b800-26a6fd335cf2 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:16.159787 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5fbe378a-8c7a-47eb-b800-26a6fd335cf2 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:16.160788 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5fbe378a-8c7a-47eb-b800-26a6fd335cf2 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:16.161422 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5fbe378a-8c7a-47eb-b800-26a6fd335cf2 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:16.167615 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-03d7d562-14ff-4e9e-91f0-5a70b7b8271d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:16.169525 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-03d7d562-14ff-4e9e-91f0-5a70b7b8271d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:16.170744 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-03d7d562-14ff-4e9e-91f0-5a70b7b8271d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1729 microversion: 2.20 time: 0.178017 Feb 15 14:31:16.180490 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 403/795] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:31:15 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:31:16.316835 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-5fbe378a-8c7a-47eb-b800-26a6fd335cf2 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:16.324548 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-5fbe378a-8c7a-47eb-b800-26a6fd335cf2 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1676 microversion: 2.1 time: 0.179191 Feb 15 14:31:16.329221 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 393/796] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:31:16 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:31:17.189615 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-655e3d67-101d-41d3-8bd8-dd682b9bff26 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:17.190366 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-655e3d67-101d-41d3-8bd8-dd682b9bff26 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:17.197533 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-655e3d67-101d-41d3-8bd8-dd682b9bff26 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:17.197990 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-655e3d67-101d-41d3-8bd8-dd682b9bff26 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:17.199136 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-655e3d67-101d-41d3-8bd8-dd682b9bff26 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:17.199782 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-655e3d67-101d-41d3-8bd8-dd682b9bff26 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:17.343469 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-7f2c7891-422c-4589-8bc9-179e5f2fd80d tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:17.344920 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-7f2c7891-422c-4589-8bc9-179e5f2fd80d tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:17.353732 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-655e3d67-101d-41d3-8bd8-dd682b9bff26 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:17.356615 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7f2c7891-422c-4589-8bc9-179e5f2fd80d tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:17.357074 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7f2c7891-422c-4589-8bc9-179e5f2fd80d tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:17.358033 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7f2c7891-422c-4589-8bc9-179e5f2fd80d tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:17.358470 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7f2c7891-422c-4589-8bc9-179e5f2fd80d tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:17.361833 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-655e3d67-101d-41d3-8bd8-dd682b9bff26 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:17.363425 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-655e3d67-101d-41d3-8bd8-dd682b9bff26 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:17.364763 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-655e3d67-101d-41d3-8bd8-dd682b9bff26 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1729 microversion: 2.20 time: 0.179221 Feb 15 14:31:17.365980 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 404/797] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:31:17 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:31:17.504568 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-7f2c7891-422c-4589-8bc9-179e5f2fd80d tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:17.512955 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-7f2c7891-422c-4589-8bc9-179e5f2fd80d tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1676 microversion: 2.1 time: 0.174750 Feb 15 14:31:17.514304 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 394/798] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:31:17 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:31:18.383771 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-ad577858-7d62-499a-976c-4400a00b1cd6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:18.384390 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-ad577858-7d62-499a-976c-4400a00b1cd6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:18.391932 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ad577858-7d62-499a-976c-4400a00b1cd6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:18.392697 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ad577858-7d62-499a-976c-4400a00b1cd6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:18.393492 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ad577858-7d62-499a-976c-4400a00b1cd6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:18.393930 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ad577858-7d62-499a-976c-4400a00b1cd6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:18.525245 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-ad577858-7d62-499a-976c-4400a00b1cd6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:18.531361 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-cabd8ea5-0c96-41a2-b4d5-1600756fb2c7 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:18.531978 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-cabd8ea5-0c96-41a2-b4d5-1600756fb2c7 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:18.534090 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-ad577858-7d62-499a-976c-4400a00b1cd6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:18.535603 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-ad577858-7d62-499a-976c-4400a00b1cd6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:18.536809 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-ad577858-7d62-499a-976c-4400a00b1cd6 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1729 microversion: 2.20 time: 0.156750 Feb 15 14:31:18.537370 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 405/799] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:31:18 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 14:31:18.538234 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cabd8ea5-0c96-41a2-b4d5-1600756fb2c7 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:18.538692 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cabd8ea5-0c96-41a2-b4d5-1600756fb2c7 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:18.539479 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cabd8ea5-0c96-41a2-b4d5-1600756fb2c7 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:18.539918 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cabd8ea5-0c96-41a2-b4d5-1600756fb2c7 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:18.675823 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-cabd8ea5-0c96-41a2-b4d5-1600756fb2c7 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:18.683123 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-cabd8ea5-0c96-41a2-b4d5-1600756fb2c7 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1653 microversion: 2.1 time: 0.156124 Feb 15 14:31:18.683755 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 395/800] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:31:18 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1653 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:31:18.699615 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-ddc07976-e39e-496b-a56e-3ae2e3bc13da tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:31:18.706139 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ddc07976-e39e-496b-a56e-3ae2e3bc13da tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:18.706595 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ddc07976-e39e-496b-a56e-3ae2e3bc13da tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:18.728151 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-ddc07976-e39e-496b-a56e-3ae2e3bc13da tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Going to try to start instance {{(pid=116363) start /opt/stack/nova/nova/compute/api.py:2697}} Feb 15 14:31:18.768764 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-ddc07976-e39e-496b-a56e-3ae2e3bc13da tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "POST /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851/action" status: 202 len: 0 microversion: 2.1 time: 0.072706 Feb 15 14:31:18.769424 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 406/801] 10.222.0.83 () {60 vars in 1277 bytes} [Tue Feb 15 14:31:18 2022] POST /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:31:18.778675 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-6bad5265-c753-43bf-b0b0-0b05f10298e9 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:18.780039 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-6bad5265-c753-43bf-b0b0-0b05f10298e9 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:18.786173 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6bad5265-c753-43bf-b0b0-0b05f10298e9 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:18.786630 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6bad5265-c753-43bf-b0b0-0b05f10298e9 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:18.787459 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6bad5265-c753-43bf-b0b0-0b05f10298e9 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:18.787909 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6bad5265-c753-43bf-b0b0-0b05f10298e9 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:18.938814 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-6bad5265-c753-43bf-b0b0-0b05f10298e9 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:18.946155 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-6bad5265-c753-43bf-b0b0-0b05f10298e9 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1662 microversion: 2.1 time: 0.172323 Feb 15 14:31:18.946734 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 396/802] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:31:18 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1662 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:31:19.555943 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-15aa900e-695c-4757-aecc-9ebd77c33407 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:19.556588 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-15aa900e-695c-4757-aecc-9ebd77c33407 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:19.563304 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-15aa900e-695c-4757-aecc-9ebd77c33407 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:19.563750 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-15aa900e-695c-4757-aecc-9ebd77c33407 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:19.564546 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-15aa900e-695c-4757-aecc-9ebd77c33407 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:19.564982 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-15aa900e-695c-4757-aecc-9ebd77c33407 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:19.696930 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-15aa900e-695c-4757-aecc-9ebd77c33407 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:19.704879 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-15aa900e-695c-4757-aecc-9ebd77c33407 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:19.706366 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-15aa900e-695c-4757-aecc-9ebd77c33407 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:19.707511 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-15aa900e-695c-4757-aecc-9ebd77c33407 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1729 microversion: 2.20 time: 0.156226 Feb 15 14:31:19.708068 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 407/803] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:31:19 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:31:19.964477 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-c3f6e257-dee8-436b-b91b-dac3813ec0b6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:19.965042 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-c3f6e257-dee8-436b-b91b-dac3813ec0b6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:19.972114 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c3f6e257-dee8-436b-b91b-dac3813ec0b6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:19.972606 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c3f6e257-dee8-436b-b91b-dac3813ec0b6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:19.973382 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c3f6e257-dee8-436b-b91b-dac3813ec0b6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:19.973819 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c3f6e257-dee8-436b-b91b-dac3813ec0b6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:20.105715 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-c3f6e257-dee8-436b-b91b-dac3813ec0b6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:20.113047 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-c3f6e257-dee8-436b-b91b-dac3813ec0b6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1666 microversion: 2.1 time: 0.152413 Feb 15 14:31:20.113621 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 397/804] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:31:19 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1666 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:31:20.726994 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-50500016-c376-41fb-bd02-19727a4afcbd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:20.727586 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-50500016-c376-41fb-bd02-19727a4afcbd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:20.734174 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-50500016-c376-41fb-bd02-19727a4afcbd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:20.734621 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-50500016-c376-41fb-bd02-19727a4afcbd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:20.735387 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-50500016-c376-41fb-bd02-19727a4afcbd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:20.735817 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-50500016-c376-41fb-bd02-19727a4afcbd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:20.874266 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-50500016-c376-41fb-bd02-19727a4afcbd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:20.882485 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-50500016-c376-41fb-bd02-19727a4afcbd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:20.883984 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-50500016-c376-41fb-bd02-19727a4afcbd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:20.885175 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-50500016-c376-41fb-bd02-19727a4afcbd tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1729 microversion: 2.20 time: 0.162921 Feb 15 14:31:20.885733 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 408/805] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:31:20 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:31:21.904223 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-84b030de-a20f-484d-a281-f0729f68528a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:21.904973 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-84b030de-a20f-484d-a281-f0729f68528a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:21.911223 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-84b030de-a20f-484d-a281-f0729f68528a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:21.911664 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-84b030de-a20f-484d-a281-f0729f68528a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:21.912459 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-84b030de-a20f-484d-a281-f0729f68528a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:21.912894 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-84b030de-a20f-484d-a281-f0729f68528a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:22.047398 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-84b030de-a20f-484d-a281-f0729f68528a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:22.055271 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-84b030de-a20f-484d-a281-f0729f68528a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:22.056815 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-84b030de-a20f-484d-a281-f0729f68528a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:22.057967 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-84b030de-a20f-484d-a281-f0729f68528a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1729 microversion: 2.20 time: 0.157635 Feb 15 14:31:22.058531 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 398/806] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:31:21 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:31:23.078345 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-5afdf241-7871-4c47-a87c-137d2ea37893 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:23.078989 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-5afdf241-7871-4c47-a87c-137d2ea37893 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:23.088509 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5afdf241-7871-4c47-a87c-137d2ea37893 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:23.089284 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5afdf241-7871-4c47-a87c-137d2ea37893 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:23.090605 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5afdf241-7871-4c47-a87c-137d2ea37893 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:23.091446 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5afdf241-7871-4c47-a87c-137d2ea37893 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:23.237514 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-5afdf241-7871-4c47-a87c-137d2ea37893 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:23.246450 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-5afdf241-7871-4c47-a87c-137d2ea37893 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:23.248435 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-5afdf241-7871-4c47-a87c-137d2ea37893 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:23.249649 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-5afdf241-7871-4c47-a87c-137d2ea37893 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1729 microversion: 2.20 time: 0.177101 Feb 15 14:31:23.250233 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 409/807] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:31:23 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:31:23.377429 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-7193302d-50a2-452f-a963-5049c0ec28d9 req-79e8283c-6d56-4b38-8659-db1083ce442a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1deaae9b-7503-48ca-a476-5814a26e51e0", "name": "network-vif-plugged", "status": "completed", "tag": "9bcff6b8-b07d-43be-bb6c-2f956f455705"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:31:23.379096 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:31:23.379096 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:31:23.386456 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-7193302d-50a2-452f-a963-5049c0ec28d9 req-79e8283c-6d56-4b38-8659-db1083ce442a service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:23.387306 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-7193302d-50a2-452f-a963-5049c0ec28d9 req-79e8283c-6d56-4b38-8659-db1083ce442a service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:23.400764 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-7193302d-50a2-452f-a963-5049c0ec28d9 req-79e8283c-6d56-4b38-8659-db1083ce442a service nova] Creating event network-vif-plugged:9bcff6b8-b07d-43be-bb6c-2f956f455705 for instance 1deaae9b-7503-48ca-a476-5814a26e51e0 on hv-cinder-81914 Feb 15 14:31:23.406019 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-7193302d-50a2-452f-a963-5049c0ec28d9 req-79e8283c-6d56-4b38-8659-db1083ce442a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033402 Feb 15 14:31:23.406761 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 399/808] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:31:24.273508 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-3401f42c-c9ba-4d01-9b4d-7753af8d7200 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:24.274117 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-3401f42c-c9ba-4d01-9b4d-7753af8d7200 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:24.280353 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3401f42c-c9ba-4d01-9b4d-7753af8d7200 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:24.280839 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3401f42c-c9ba-4d01-9b4d-7753af8d7200 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:24.281606 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3401f42c-c9ba-4d01-9b4d-7753af8d7200 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:24.282031 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3401f42c-c9ba-4d01-9b4d-7753af8d7200 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:24.422926 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-3401f42c-c9ba-4d01-9b4d-7753af8d7200 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:24.430801 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-3401f42c-c9ba-4d01-9b4d-7753af8d7200 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:24.432284 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-3401f42c-c9ba-4d01-9b4d-7753af8d7200 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:24.433445 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-3401f42c-c9ba-4d01-9b4d-7753af8d7200 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1729 microversion: 2.20 time: 0.163894 Feb 15 14:31:24.433999 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 410/809] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:31:24 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:31:25.457150 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-bb04c502-dd50-4818-98a4-798fcb52aa3d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:25.458435 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-bb04c502-dd50-4818-98a4-798fcb52aa3d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:25.468361 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bb04c502-dd50-4818-98a4-798fcb52aa3d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:25.469146 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bb04c502-dd50-4818-98a4-798fcb52aa3d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:25.470275 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bb04c502-dd50-4818-98a4-798fcb52aa3d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:25.471041 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bb04c502-dd50-4818-98a4-798fcb52aa3d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:25.619234 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-bb04c502-dd50-4818-98a4-798fcb52aa3d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:25.627591 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-bb04c502-dd50-4818-98a4-798fcb52aa3d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:25.629154 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-bb04c502-dd50-4818-98a4-798fcb52aa3d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:25.630292 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-bb04c502-dd50-4818-98a4-798fcb52aa3d tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1729 microversion: 2.20 time: 0.181557 Feb 15 14:31:25.630855 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 400/810] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:31:25 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 14:31:26.649438 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-96357691-ed9f-40c6-8f5a-1ed244059d4e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:26.650050 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-96357691-ed9f-40c6-8f5a-1ed244059d4e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:26.657337 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-96357691-ed9f-40c6-8f5a-1ed244059d4e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:26.657802 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-96357691-ed9f-40c6-8f5a-1ed244059d4e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:26.658569 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-96357691-ed9f-40c6-8f5a-1ed244059d4e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:26.659001 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-96357691-ed9f-40c6-8f5a-1ed244059d4e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:26.797518 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-96357691-ed9f-40c6-8f5a-1ed244059d4e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:26.805213 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-96357691-ed9f-40c6-8f5a-1ed244059d4e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:26.806714 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-96357691-ed9f-40c6-8f5a-1ed244059d4e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:26.807862 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-96357691-ed9f-40c6-8f5a-1ed244059d4e tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1716 microversion: 2.20 time: 0.162638 Feb 15 14:31:26.808439 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 411/811] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:31:26 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1716 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:31:59.301295 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-9b8f1177-15b2-4bc6-a855-f617f89fcc52 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:59.302248 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-9b8f1177-15b2-4bc6-a855-f617f89fcc52 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:59.308243 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9b8f1177-15b2-4bc6-a855-f617f89fcc52 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:59.308722 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9b8f1177-15b2-4bc6-a855-f617f89fcc52 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:59.309505 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9b8f1177-15b2-4bc6-a855-f617f89fcc52 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:59.310437 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9b8f1177-15b2-4bc6-a855-f617f89fcc52 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:59.338878 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-9b8f1177-15b2-4bc6-a855-f617f89fcc52 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041441 Feb 15 14:31:59.339433 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 401/812] 10.222.0.83 () {58 vars in 1301 bytes} [Tue Feb 15 14:31:59 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 14:31:59.353473 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-16fa67a5-7bde-4f3b-af51-d2ba2e355e76 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:59.353969 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-16fa67a5-7bde-4f3b-af51-d2ba2e355e76 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 8808332d-30a8-493a-99cd-e95447b41793] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:59.359922 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-16fa67a5-7bde-4f3b-af51-d2ba2e355e76 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:59.360373 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-16fa67a5-7bde-4f3b-af51-d2ba2e355e76 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:59.361204 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-16fa67a5-7bde-4f3b-af51-d2ba2e355e76 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:59.361641 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-16fa67a5-7bde-4f3b-af51-d2ba2e355e76 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:59.386180 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-16fa67a5-7bde-4f3b-af51-d2ba2e355e76 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 8808332d-30a8-493a-99cd-e95447b41793] Going to try to terminate instance {{(pid=116363) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 14:31:59.394988 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-d610347a-01e4-4ca5-9010-26216fb67a43 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:59.395569 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-d610347a-01e4-4ca5-9010-26216fb67a43 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:59.402061 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d610347a-01e4-4ca5-9010-26216fb67a43 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:59.402519 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d610347a-01e4-4ca5-9010-26216fb67a43 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:59.403372 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d610347a-01e4-4ca5-9010-26216fb67a43 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:59.403883 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d610347a-01e4-4ca5-9010-26216fb67a43 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:59.428374 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-d610347a-01e4-4ca5-9010-26216fb67a43 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Going to try to terminate instance {{(pid=116362) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 14:31:59.467411 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-16fa67a5-7bde-4f3b-af51-d2ba2e355e76 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "DELETE /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793" status: 204 len: 0 microversion: 2.1 time: 0.117134 Feb 15 14:31:59.468216 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 412/813] 10.222.0.83 () {58 vars in 1238 bytes} [Tue Feb 15 14:31:59 2022] DELETE /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 14:31:59.476753 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-f3d792a4-dcb6-4121-ab5b-2cfd63ca1d44 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:59.477451 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-f3d792a4-dcb6-4121-ab5b-2cfd63ca1d44 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 8808332d-30a8-493a-99cd-e95447b41793] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:59.483310 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f3d792a4-dcb6-4121-ab5b-2cfd63ca1d44 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:59.483765 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f3d792a4-dcb6-4121-ab5b-2cfd63ca1d44 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:59.484588 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f3d792a4-dcb6-4121-ab5b-2cfd63ca1d44 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:59.485027 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f3d792a4-dcb6-4121-ab5b-2cfd63ca1d44 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:59.506386 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-d610347a-01e4-4ca5-9010-26216fb67a43 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "DELETE /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 204 len: 0 microversion: 2.1 time: 0.114611 Feb 15 14:31:59.506978 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 402/814] 10.222.0.83 () {58 vars in 1238 bytes} [Tue Feb 15 14:31:59 2022] DELETE /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 15 14:31:59.516704 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-7fd5d4cb-6d76-44db-9060-11b3ab276e46 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:31:59.517433 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-7fd5d4cb-6d76-44db-9060-11b3ab276e46 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:31:59.523867 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7fd5d4cb-6d76-44db-9060-11b3ab276e46 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:59.524378 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7fd5d4cb-6d76-44db-9060-11b3ab276e46 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:59.525201 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7fd5d4cb-6d76-44db-9060-11b3ab276e46 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:31:59.525639 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7fd5d4cb-6d76-44db-9060-11b3ab276e46 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:31:59.629822 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-f3d792a4-dcb6-4121-ab5b-2cfd63ca1d44 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:59.637451 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-f3d792a4-dcb6-4121-ab5b-2cfd63ca1d44 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793" status: 200 len: 1576 microversion: 2.1 time: 0.164500 Feb 15 14:31:59.638028 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 413/815] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:31:59 2022] GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:31:59.666369 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-7fd5d4cb-6d76-44db-9060-11b3ab276e46 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:31:59.674259 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-7fd5d4cb-6d76-44db-9060-11b3ab276e46 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1672 microversion: 2.1 time: 0.162192 Feb 15 14:31:59.674831 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 403/816] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:31:59 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:32:00.656439 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-ff3dad33-fa8b-4930-b5e7-07864e881556 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:00.657054 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-ff3dad33-fa8b-4930-b5e7-07864e881556 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 8808332d-30a8-493a-99cd-e95447b41793] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:00.663714 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ff3dad33-fa8b-4930-b5e7-07864e881556 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:00.664166 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ff3dad33-fa8b-4930-b5e7-07864e881556 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:00.664968 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ff3dad33-fa8b-4930-b5e7-07864e881556 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:00.665411 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ff3dad33-fa8b-4930-b5e7-07864e881556 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:00.690769 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-e078f246-346e-478f-95a0-8fd5367002f6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:00.691417 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-e078f246-346e-478f-95a0-8fd5367002f6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:00.697883 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e078f246-346e-478f-95a0-8fd5367002f6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:00.698337 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e078f246-346e-478f-95a0-8fd5367002f6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:00.699123 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e078f246-346e-478f-95a0-8fd5367002f6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:00.699565 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-e078f246-346e-478f-95a0-8fd5367002f6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:00.801088 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-ff3dad33-fa8b-4930-b5e7-07864e881556 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:00.808604 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-ff3dad33-fa8b-4930-b5e7-07864e881556 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793" status: 200 len: 1576 microversion: 2.1 time: 0.156452 Feb 15 14:32:00.809187 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 414/817] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:00 2022] GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:00.836615 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-e078f246-346e-478f-95a0-8fd5367002f6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:00.844013 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-e078f246-346e-478f-95a0-8fd5367002f6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1672 microversion: 2.1 time: 0.156795 Feb 15 14:32:00.844614 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 404/818] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:00 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:32:01.827341 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-497c80a8-1c39-4811-bbf9-d1e2d7444387 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:01.827989 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-497c80a8-1c39-4811-bbf9-d1e2d7444387 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 8808332d-30a8-493a-99cd-e95447b41793] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:01.834315 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-497c80a8-1c39-4811-bbf9-d1e2d7444387 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:01.834772 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-497c80a8-1c39-4811-bbf9-d1e2d7444387 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:01.835559 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-497c80a8-1c39-4811-bbf9-d1e2d7444387 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:01.835998 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-497c80a8-1c39-4811-bbf9-d1e2d7444387 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:01.861718 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-ade39114-7284-4baf-a478-b721677632be tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:01.862938 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-ade39114-7284-4baf-a478-b721677632be tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:01.869299 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ade39114-7284-4baf-a478-b721677632be tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:01.869684 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ade39114-7284-4baf-a478-b721677632be tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:01.870477 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ade39114-7284-4baf-a478-b721677632be tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:01.870916 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ade39114-7284-4baf-a478-b721677632be tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:02.005716 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-ade39114-7284-4baf-a478-b721677632be tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:02.014259 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-ade39114-7284-4baf-a478-b721677632be tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1672 microversion: 2.1 time: 0.156091 Feb 15 14:32:02.015069 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 405/819] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:01 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:32:02.106265 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-497c80a8-1c39-4811-bbf9-d1e2d7444387 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:02.116535 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-497c80a8-1c39-4811-bbf9-d1e2d7444387 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793" status: 200 len: 1576 microversion: 2.1 time: 0.293272 Feb 15 14:32:02.117630 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 415/820] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:01 2022] GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793 => generated 1576 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:02.510282 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-661d711e-89ad-4b7c-a89e-38b027bd2837 req-baf40c8a-ecfa-4023-a0ab-59a063a42c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8808332d-30a8-493a-99cd-e95447b41793", "name": "network-vif-deleted", "tag": "105c6fc7-9772-45c2-b2d2-16cff04ab385"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:32:02.512035 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:32:02.512035 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:32:02.522900 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-661d711e-89ad-4b7c-a89e-38b027bd2837 req-baf40c8a-ecfa-4023-a0ab-59a063a42c27 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:02.523726 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-661d711e-89ad-4b7c-a89e-38b027bd2837 req-baf40c8a-ecfa-4023-a0ab-59a063a42c27 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:02.537249 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-661d711e-89ad-4b7c-a89e-38b027bd2837 req-baf40c8a-ecfa-4023-a0ab-59a063a42c27 service nova] Creating event network-vif-deleted:105c6fc7-9772-45c2-b2d2-16cff04ab385 for instance 8808332d-30a8-493a-99cd-e95447b41793 on hv-cinder-81914 Feb 15 14:32:02.543614 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-661d711e-89ad-4b7c-a89e-38b027bd2837 req-baf40c8a-ecfa-4023-a0ab-59a063a42c27 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036837 Feb 15 14:32:02.545950 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 406/821] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:32:03.034385 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-0708dba9-568b-4324-896c-161ce3d67607 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:03.035229 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-0708dba9-568b-4324-896c-161ce3d67607 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:03.043072 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0708dba9-568b-4324-896c-161ce3d67607 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:03.043796 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0708dba9-568b-4324-896c-161ce3d67607 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:03.044850 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0708dba9-568b-4324-896c-161ce3d67607 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:03.045529 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0708dba9-568b-4324-896c-161ce3d67607 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:03.120442 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-0708dba9-568b-4324-896c-161ce3d67607 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:03.129591 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-0708dba9-568b-4324-896c-161ce3d67607 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 200 len: 1605 microversion: 2.1 time: 0.101463 Feb 15 14:32:03.135724 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-4ba48ecc-9c4a-45b2-a231-1e088fd68429 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:03.137120 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-4ba48ecc-9c4a-45b2-a231-1e088fd68429 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 8808332d-30a8-493a-99cd-e95447b41793] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:03.141685 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 416/822] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:03 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 1605 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:03.145199 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4ba48ecc-9c4a-45b2-a231-1e088fd68429 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:03.145730 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4ba48ecc-9c4a-45b2-a231-1e088fd68429 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:03.146855 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4ba48ecc-9c4a-45b2-a231-1e088fd68429 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:03.147511 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4ba48ecc-9c4a-45b2-a231-1e088fd68429 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:03.179007 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4ba48ecc-9c4a-45b2-a231-1e088fd68429 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:03.179727 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4ba48ecc-9c4a-45b2-a231-1e088fd68429 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:03.180379 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.objects.instance [None req-4ba48ecc-9c4a-45b2-a231-1e088fd68429 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lazy-loading 'fault' on Instance uuid 8808332d-30a8-493a-99cd-e95447b41793 {{(pid=116362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:32:03.281493 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-4ba48ecc-9c4a-45b2-a231-1e088fd68429 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:03.291339 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-4ba48ecc-9c4a-45b2-a231-1e088fd68429 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793" status: 200 len: 1229 microversion: 2.1 time: 0.160084 Feb 15 14:32:03.303115 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 407/823] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:03 2022] GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793 => generated 1229 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:03.382613 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-05d026f5-4074-4ccb-9cd0-9ece3d9ec860 req-564bd004-a03b-4559-9654-36e995e5598f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db561480-36d5-4879-aa89-d62bf3623851", "name": "network-vif-deleted", "tag": "012c5a46-cbe3-4127-98c8-54961f7dbe01"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:32:03.384502 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:32:03.384502 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:32:03.392514 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-05d026f5-4074-4ccb-9cd0-9ece3d9ec860 req-564bd004-a03b-4559-9654-36e995e5598f service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:03.392961 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-05d026f5-4074-4ccb-9cd0-9ece3d9ec860 req-564bd004-a03b-4559-9654-36e995e5598f service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:03.407436 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-05d026f5-4074-4ccb-9cd0-9ece3d9ec860 req-564bd004-a03b-4559-9654-36e995e5598f service nova] Creating event network-vif-deleted:012c5a46-cbe3-4127-98c8-54961f7dbe01 for instance db561480-36d5-4879-aa89-d62bf3623851 on hv-cinder-81914 Feb 15 14:32:03.416172 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-05d026f5-4074-4ccb-9cd0-9ece3d9ec860 req-564bd004-a03b-4559-9654-36e995e5598f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037373 Feb 15 14:32:03.417029 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 417/824] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:32:04.147081 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-2fd56d52-a751-465c-b321-05c4ca7bd3a4 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:04.147689 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-2fd56d52-a751-465c-b321-05c4ca7bd3a4 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:04.153985 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2fd56d52-a751-465c-b321-05c4ca7bd3a4 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:04.154432 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2fd56d52-a751-465c-b321-05c4ca7bd3a4 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:04.155213 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2fd56d52-a751-465c-b321-05c4ca7bd3a4 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:04.155653 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2fd56d52-a751-465c-b321-05c4ca7bd3a4 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:04.168624 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.wsgi [None req-2fd56d52-a751-465c-b321-05c4ca7bd3a4 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] HTTP exception thrown: Instance db561480-36d5-4879-aa89-d62bf3623851 could not be found. Feb 15 14:32:04.169743 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-2fd56d52-a751-465c-b321-05c4ca7bd3a4 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Returning 404 to user: Instance db561480-36d5-4879-aa89-d62bf3623851 could not be found. {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:32:04.170577 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-2fd56d52-a751-465c-b321-05c4ca7bd3a4 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 404 len: 111 microversion: 2.1 time: 0.027415 Feb 15 14:32:04.171101 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 408/825] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:04 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:32:04.180207 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-94489d7f-a0fc-40ae-be5a-08ce586abcca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '.version_select at 0x7fd74f720af0>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:04.198593 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-94489d7f-a0fc-40ae-be5a-08ce586abcca tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-818690589" status: 202 len: 0 microversion: 2.1 time: 0.022692 Feb 15 14:32:04.199179 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 418/826] 10.222.0.83 () {58 vars in 1217 bytes} [Tue Feb 15 14:32:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-818690589 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:32:04.308977 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-5f09419d-30b5-4651-bf94-df553fdb1ec1 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:04.310619 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-5f09419d-30b5-4651-bf94-df553fdb1ec1 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 8808332d-30a8-493a-99cd-e95447b41793] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:04.317591 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5f09419d-30b5-4651-bf94-df553fdb1ec1 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:04.318160 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5f09419d-30b5-4651-bf94-df553fdb1ec1 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:04.319496 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5f09419d-30b5-4651-bf94-df553fdb1ec1 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:04.319951 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5f09419d-30b5-4651-bf94-df553fdb1ec1 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:04.335756 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.wsgi [None req-5f09419d-30b5-4651-bf94-df553fdb1ec1 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] HTTP exception thrown: Instance 8808332d-30a8-493a-99cd-e95447b41793 could not be found. Feb 15 14:32:04.336358 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-5f09419d-30b5-4651-bf94-df553fdb1ec1 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Returning 404 to user: Instance 8808332d-30a8-493a-99cd-e95447b41793 could not be found. {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:32:04.337263 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-5f09419d-30b5-4651-bf94-df553fdb1ec1 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793" status: 404 len: 111 microversion: 2.1 time: 0.032207 Feb 15 14:32:04.338160 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 409/827] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:04 2022] GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:32:04.449330 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-27fab4e7-f674-4d0f-b97d-8ab543d8d38a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-628676974", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-218978542", "security_groups": [{"name": "tempest-secgroup-smoke-2122136391"}], "block_device_mapping_v2": [{"uuid": "476028f3-5e9b-4364-87e9-e4b365689521", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f56af738-73d1-43bd-9e25-bf9a658bed0c"}]}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:32:04.617351 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.network.neutron [None req-27fab4e7-f674-4d0f-b97d-8ab543d8d38a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] validate_networks() for [('f56af738-73d1-43bd-9e25-bf9a658bed0c', None, None, None, None, None)] {{(pid=116363) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 14:32:04.993384 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-a2f7dd7b-0e21-4b5e-ae14-02f20fb82cb4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:04.994366 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-a2f7dd7b-0e21-4b5e-ae14-02f20fb82cb4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:05.000841 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a2f7dd7b-0e21-4b5e-ae14-02f20fb82cb4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:05.001299 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a2f7dd7b-0e21-4b5e-ae14-02f20fb82cb4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:05.002087 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a2f7dd7b-0e21-4b5e-ae14-02f20fb82cb4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:05.002527 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a2f7dd7b-0e21-4b5e-ae14-02f20fb82cb4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:05.031477 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-a2f7dd7b-0e21-4b5e-ae14-02f20fb82cb4 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041827 Feb 15 14:32:05.032234 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 410/828] 10.222.0.83 () {60 vars in 1342 bytes} [Tue Feb 15 14:32:04 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:32:05.063677 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-a76eb0ee-2d56-45e8-8fa1-0148fd47845e tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Action: 'create', calling method: .version_select at 0x7fd74f543f70>, body: {"keypair": {"name": "tempest-keypair-1774728001"}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:32:05.077745 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-a76eb0ee-2d56-45e8-8fa1-0148fd47845e tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Getting quotas for project daa71715dd644b259ad6713b99c6a3d4. Resources: {'key_pairs'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:32:05.081979 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-a76eb0ee-2d56-45e8-8fa1-0148fd47845e tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Getting quotas for user c9f121c2569f456ba0f2374744491315 and project daa71715dd644b259ad6713b99c6a3d4. Resources: {'key_pairs'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:32:05.174679 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-27fab4e7-f674-4d0f-b97d-8ab543d8d38a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Flavor limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 14:32:05.175170 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-27fab4e7-f674-4d0f-b97d-8ab543d8d38a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Image limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 14:32:05.175720 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-27fab4e7-f674-4d0f-b97d-8ab543d8d38a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Flavor pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 14:32:05.176133 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-27fab4e7-f674-4d0f-b97d-8ab543d8d38a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Image pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 14:32:05.176575 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-27fab4e7-f674-4d0f-b97d-8ab543d8d38a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 14:32:05.186858 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-27fab4e7-f674-4d0f-b97d-8ab543d8d38a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:05.187488 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-27fab4e7-f674-4d0f-b97d-8ab543d8d38a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:05.188105 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-27fab4e7-f674-4d0f-b97d-8ab543d8d38a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:05.188575 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-27fab4e7-f674-4d0f-b97d-8ab543d8d38a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:05.194015 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-a76eb0ee-2d56-45e8-8fa1-0148fd47845e tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Getting quotas for project daa71715dd644b259ad6713b99c6a3d4. Resources: {'key_pairs'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:32:05.198007 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-a76eb0ee-2d56-45e8-8fa1-0148fd47845e tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Getting quotas for user c9f121c2569f456ba0f2374744491315 and project daa71715dd644b259ad6713b99c6a3d4. Resources: {'key_pairs'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:32:05.204794 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-27fab4e7-f674-4d0f-b97d-8ab543d8d38a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Getting quotas for project 9bc1601015ff4805a2884b047df84013. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:32:05.208719 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-27fab4e7-f674-4d0f-b97d-8ab543d8d38a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Getting quotas for user 41a62058dca64450aa608973422ff9bd and project 9bc1601015ff4805a2884b047df84013. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:32:05.210774 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-a76eb0ee-2d56-45e8-8fa1-0148fd47845e tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.151552 Feb 15 14:32:05.211367 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 411/829] 10.222.0.83 () {60 vars in 1157 bytes} [Tue Feb 15 14:32:05 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:05.215577 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-819861fd-9c11-418a-bc60-71d0d53e59f2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:05.216061 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-819861fd-9c11-418a-bc60-71d0d53e59f2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:05.224859 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-819861fd-9c11-418a-bc60-71d0d53e59f2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:05.225686 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-819861fd-9c11-418a-bc60-71d0d53e59f2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:05.226618 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-819861fd-9c11-418a-bc60-71d0d53e59f2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:05.227234 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-819861fd-9c11-418a-bc60-71d0d53e59f2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:05.256507 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-819861fd-9c11-418a-bc60-71d0d53e59f2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Going to try to terminate instance {{(pid=116362) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 14:32:05.269367 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-27fab4e7-f674-4d0f-b97d-8ab543d8d38a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Going to run 1 instances... {{(pid=116363) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 14:32:05.271997 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-27fab4e7-f674-4d0f-b97d-8ab543d8d38a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 9675ad13-9333-4efc-8f5d-2a22f16aa74f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='476028f3-5e9b-4364-87e9-e4b365689521',volume_size=None,volume_type=None)] {{(pid=116363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 14:32:05.360660 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-819861fd-9c11-418a-bc60-71d0d53e59f2 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "DELETE /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 204 len: 0 microversion: 2.20 time: 0.147945 Feb 15 14:32:05.361599 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 412/830] 10.222.0.83 () {60 vars in 1279 bytes} [Tue Feb 15 14:32:05 2022] DELETE /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 15 14:32:05.370617 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-7e5ba33c-6a88-4775-82f0-880c4a634cc0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:05.371313 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-7e5ba33c-6a88-4775-82f0-880c4a634cc0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:05.377918 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7e5ba33c-6a88-4775-82f0-880c4a634cc0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:05.378618 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7e5ba33c-6a88-4775-82f0-880c4a634cc0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:05.380034 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7e5ba33c-6a88-4775-82f0-880c4a634cc0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:05.380762 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7e5ba33c-6a88-4775-82f0-880c4a634cc0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:05.430985 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-27fab4e7-f674-4d0f-b97d-8ab543d8d38a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.985176 Feb 15 14:32:05.432024 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 419/831] 10.222.0.83 () {60 vars in 1146 bytes} [Tue Feb 15 14:32:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 14:32:05.442203 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-4335cd09-810b-4bd5-a952-bf15e7cf51c1 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:05.442825 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-4335cd09-810b-4bd5-a952-bf15e7cf51c1 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 9675ad13-9333-4efc-8f5d-2a22f16aa74f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:05.507472 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-4335cd09-810b-4bd5-a952-bf15e7cf51c1 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:05.517083 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-4335cd09-810b-4bd5-a952-bf15e7cf51c1 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f" status: 200 len: 1093 microversion: 2.1 time: 0.078624 Feb 15 14:32:05.519274 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 420/832] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:05 2022] GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f => generated 1093 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:05.616584 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-7e5ba33c-6a88-4775-82f0-880c4a634cc0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:05.625743 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-7e5ba33c-6a88-4775-82f0-880c4a634cc0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:05.627863 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-7e5ba33c-6a88-4775-82f0-880c4a634cc0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:05.629186 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-7e5ba33c-6a88-4775-82f0-880c4a634cc0 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1722 microversion: 2.20 time: 0.263279 Feb 15 14:32:05.630137 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 413/833] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:32:05 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:32:06.537402 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-896a6b89-e6b1-443e-b51b-9ece37f8e338 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:06.538789 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-896a6b89-e6b1-443e-b51b-9ece37f8e338 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 9675ad13-9333-4efc-8f5d-2a22f16aa74f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:06.553536 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-896a6b89-e6b1-443e-b51b-9ece37f8e338 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:06.554000 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-896a6b89-e6b1-443e-b51b-9ece37f8e338 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:06.554832 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-896a6b89-e6b1-443e-b51b-9ece37f8e338 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:06.555566 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-896a6b89-e6b1-443e-b51b-9ece37f8e338 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:06.622960 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-896a6b89-e6b1-443e-b51b-9ece37f8e338 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:06.630357 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-896a6b89-e6b1-443e-b51b-9ece37f8e338 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f" status: 200 len: 1209 microversion: 2.1 time: 0.098068 Feb 15 14:32:06.630931 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 421/834] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:06 2022] GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f => generated 1209 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:06.650662 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-9cbdadad-1925-4a69-90fd-378df3e0b78c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:06.651502 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-9cbdadad-1925-4a69-90fd-378df3e0b78c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:06.658173 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9cbdadad-1925-4a69-90fd-378df3e0b78c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:06.658713 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9cbdadad-1925-4a69-90fd-378df3e0b78c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:06.659573 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9cbdadad-1925-4a69-90fd-378df3e0b78c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:06.660498 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9cbdadad-1925-4a69-90fd-378df3e0b78c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:06.671734 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-076bab91-6b20-4e13-9030-710b59158749 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-9109604", "imageRef": "da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fef2f674-f393-4182-96e5-05e9c8ae5530"}], "security_groups": [{"name": "tempest-securitygroup--896920535"}], "key_name": "tempest-keypair-1774728001", "user_data": "}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:32:06.774994 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.network.neutron [None req-076bab91-6b20-4e13-9030-710b59158749 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] validate_networks() for [('fef2f674-f393-4182-96e5-05e9c8ae5530', None, None, None, None, None)] {{(pid=116363) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 14:32:06.897546 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-9cbdadad-1925-4a69-90fd-378df3e0b78c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:06.912337 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-9cbdadad-1925-4a69-90fd-378df3e0b78c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:06.914237 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-9cbdadad-1925-4a69-90fd-378df3e0b78c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:06.915455 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-9cbdadad-1925-4a69-90fd-378df3e0b78c tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1722 microversion: 2.20 time: 0.269775 Feb 15 14:32:06.916160 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 414/835] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:32:06 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:32:07.555701 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-076bab91-6b20-4e13-9030-710b59158749 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Flavor limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 14:32:07.557236 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-076bab91-6b20-4e13-9030-710b59158749 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Image limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 14:32:07.557737 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-076bab91-6b20-4e13-9030-710b59158749 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Flavor pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 14:32:07.558139 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-076bab91-6b20-4e13-9030-710b59158749 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Image pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 14:32:07.558557 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-076bab91-6b20-4e13-9030-710b59158749 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 14:32:07.570847 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-076bab91-6b20-4e13-9030-710b59158749 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:07.571357 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-076bab91-6b20-4e13-9030-710b59158749 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:07.572112 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-076bab91-6b20-4e13-9030-710b59158749 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:07.572594 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-076bab91-6b20-4e13-9030-710b59158749 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:07.591752 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-076bab91-6b20-4e13-9030-710b59158749 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Getting quotas for project daa71715dd644b259ad6713b99c6a3d4. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:32:07.595567 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-076bab91-6b20-4e13-9030-710b59158749 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Getting quotas for user c9f121c2569f456ba0f2374744491315 and project daa71715dd644b259ad6713b99c6a3d4. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:32:07.606896 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-076bab91-6b20-4e13-9030-710b59158749 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Going to run 1 instances... {{(pid=116363) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 14:32:07.609131 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-076bab91-6b20-4e13-9030-710b59158749 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 14:32:07.651029 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-2bf67da9-3bc1-4eed-95c5-32a532c26cf8 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:07.651634 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-2bf67da9-3bc1-4eed-95c5-32a532c26cf8 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 9675ad13-9333-4efc-8f5d-2a22f16aa74f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:07.658043 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2bf67da9-3bc1-4eed-95c5-32a532c26cf8 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:07.659130 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2bf67da9-3bc1-4eed-95c5-32a532c26cf8 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:07.660085 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2bf67da9-3bc1-4eed-95c5-32a532c26cf8 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:07.660707 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2bf67da9-3bc1-4eed-95c5-32a532c26cf8 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:07.686633 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-076bab91-6b20-4e13-9030-710b59158749 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.015507 Feb 15 14:32:07.687544 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 422/836] 10.222.0.83 () {60 vars in 1146 bytes} [Tue Feb 15 14:32:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 14:32:07.698276 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-d146ba6f-4cad-40ec-b5b5-e5115160564b tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:07.699159 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-d146ba6f-4cad-40ec-b5b5-e5115160564b tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:07.776950 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-d146ba6f-4cad-40ec-b5b5-e5115160564b tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:07.793341 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-d146ba6f-4cad-40ec-b5b5-e5115160564b tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028" status: 200 len: 1235 microversion: 2.1 time: 0.099266 Feb 15 14:32:07.802512 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 423/837] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:07 2022] GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028 => generated 1235 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:32:07.936903 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-fd201a1c-033c-4a2e-903a-d6646dd43264 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:07.937819 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-fd201a1c-033c-4a2e-903a-d6646dd43264 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:07.944966 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-fd201a1c-033c-4a2e-903a-d6646dd43264 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:07.946358 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-fd201a1c-033c-4a2e-903a-d6646dd43264 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:07.947526 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-fd201a1c-033c-4a2e-903a-d6646dd43264 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:07.948420 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-fd201a1c-033c-4a2e-903a-d6646dd43264 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:08.236998 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-2bf67da9-3bc1-4eed-95c5-32a532c26cf8 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:08.244673 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-fd201a1c-033c-4a2e-903a-d6646dd43264 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:08.249454 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-2bf67da9-3bc1-4eed-95c5-32a532c26cf8 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f" status: 200 len: 1265 microversion: 2.1 time: 0.602156 Feb 15 14:32:08.250178 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 415/838] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:07 2022] GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f => generated 1265 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:32:08.261810 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-fd201a1c-033c-4a2e-903a-d6646dd43264 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:08.266069 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-fd201a1c-033c-4a2e-903a-d6646dd43264 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85c1d5b9f2f44555ad5d2d79e7adbb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061f138bf57a450295694607670540c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:08.274050 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-fd201a1c-033c-4a2e-903a-d6646dd43264 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 200 len: 1722 microversion: 2.20 time: 0.343077 Feb 15 14:32:08.275288 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 424/839] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:32:07 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 1722 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 14:32:08.326161 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-7e4261d3-f8da-4e00-922d-94804d5f190e req-fb2be28f-0e8f-4576-a2df-3fc1446d2d10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9675ad13-9333-4efc-8f5d-2a22f16aa74f", "tag": "53f4cc4e-a4dd-4cdd-87a5-4465c9f43dc1"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:32:08.327846 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:32:08.327846 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:32:08.337374 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-7e4261d3-f8da-4e00-922d-94804d5f190e req-fb2be28f-0e8f-4576-a2df-3fc1446d2d10 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:08.337817 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-7e4261d3-f8da-4e00-922d-94804d5f190e req-fb2be28f-0e8f-4576-a2df-3fc1446d2d10 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:08.353100 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-7e4261d3-f8da-4e00-922d-94804d5f190e req-fb2be28f-0e8f-4576-a2df-3fc1446d2d10 service nova] Creating event network-changed:53f4cc4e-a4dd-4cdd-87a5-4465c9f43dc1 for instance 9675ad13-9333-4efc-8f5d-2a22f16aa74f on hv-cinder-81914 Feb 15 14:32:08.359215 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-7e4261d3-f8da-4e00-922d-94804d5f190e req-fb2be28f-0e8f-4576-a2df-3fc1446d2d10 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039510 Feb 15 14:32:08.360341 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 416/840] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:32:08.631577 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-f251571e-816a-47ce-8310-6002e9a0b776 req-74938943-c036-46be-a850-33b28fa2ef92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1deaae9b-7503-48ca-a476-5814a26e51e0", "name": "network-vif-deleted", "tag": "9bcff6b8-b07d-43be-bb6c-2f956f455705"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:32:08.639435 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:32:08.639435 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:32:08.649790 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-f251571e-816a-47ce-8310-6002e9a0b776 req-74938943-c036-46be-a850-33b28fa2ef92 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:08.650707 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-f251571e-816a-47ce-8310-6002e9a0b776 req-74938943-c036-46be-a850-33b28fa2ef92 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:08.672993 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-f251571e-816a-47ce-8310-6002e9a0b776 req-74938943-c036-46be-a850-33b28fa2ef92 service nova] Creating event network-vif-deleted:9bcff6b8-b07d-43be-bb6c-2f956f455705 for instance 1deaae9b-7503-48ca-a476-5814a26e51e0 on hv-cinder-81914 Feb 15 14:32:08.678745 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-f251571e-816a-47ce-8310-6002e9a0b776 req-74938943-c036-46be-a850-33b28fa2ef92 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052130 Feb 15 14:32:08.679870 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 425/841] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:32:08.821098 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-957edb71-b8cf-4409-92e8-016a773dfac0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:08.821884 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-957edb71-b8cf-4409-92e8-016a773dfac0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:08.832153 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-957edb71-b8cf-4409-92e8-016a773dfac0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:08.836359 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-957edb71-b8cf-4409-92e8-016a773dfac0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:08.837216 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-957edb71-b8cf-4409-92e8-016a773dfac0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:08.837664 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-957edb71-b8cf-4409-92e8-016a773dfac0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:08.916658 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-957edb71-b8cf-4409-92e8-016a773dfac0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:08.924674 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-957edb71-b8cf-4409-92e8-016a773dfac0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028" status: 200 len: 1287 microversion: 2.1 time: 0.108608 Feb 15 14:32:08.936014 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 417/842] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:08 2022] GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028 => generated 1287 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:09.269459 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-71366e2e-3861-4185-acd5-31e673054741 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:09.271588 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-71366e2e-3861-4185-acd5-31e673054741 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 9675ad13-9333-4efc-8f5d-2a22f16aa74f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:09.282592 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-71366e2e-3861-4185-acd5-31e673054741 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:09.283832 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-71366e2e-3861-4185-acd5-31e673054741 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:09.285162 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-71366e2e-3861-4185-acd5-31e673054741 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:09.286221 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-71366e2e-3861-4185-acd5-31e673054741 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:09.294452 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-4b90ab1d-0f4f-4c52-adba-2a7a6a3cf8be tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:09.295667 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-4b90ab1d-0f4f-4c52-adba-2a7a6a3cf8be tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:09.306527 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4b90ab1d-0f4f-4c52-adba-2a7a6a3cf8be tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:09.308190 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4b90ab1d-0f4f-4c52-adba-2a7a6a3cf8be tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:09.310831 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4b90ab1d-0f4f-4c52-adba-2a7a6a3cf8be tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:09.311526 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4b90ab1d-0f4f-4c52-adba-2a7a6a3cf8be tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:09.345527 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.wsgi [None req-4b90ab1d-0f4f-4c52-adba-2a7a6a3cf8be tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] HTTP exception thrown: Instance 1deaae9b-7503-48ca-a476-5814a26e51e0 could not be found. Feb 15 14:32:09.346830 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-4b90ab1d-0f4f-4c52-adba-2a7a6a3cf8be tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Returning 404 to user: Instance 1deaae9b-7503-48ca-a476-5814a26e51e0 could not be found. {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:32:09.348080 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-4b90ab1d-0f4f-4c52-adba-2a7a6a3cf8be tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 404 len: 111 microversion: 2.20 time: 0.057718 Feb 15 14:32:09.349907 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 418/843] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:32:09 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 15 14:32:09.359488 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-c2808a92-eceb-4fb4-b4ee-bf90eafae781 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '.version_select at 0x7fd74fefea60>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:09.380255 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-c2808a92-eceb-4fb4-b4ee-bf90eafae781 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-511061171" status: 204 len: 0 microversion: 2.20 time: 0.024952 Feb 15 14:32:09.381612 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 419/844] 10.222.0.83 () {60 vars in 1258 bytes} [Tue Feb 15 14:32:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-511061171 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 15 14:32:09.587225 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-71366e2e-3861-4185-acd5-31e673054741 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:09.598748 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-71366e2e-3861-4185-acd5-31e673054741 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f" status: 200 len: 1265 microversion: 2.1 time: 0.334184 Feb 15 14:32:09.614763 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 426/845] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:09 2022] GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f => generated 1265 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:09.943131 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-037154b3-7ec0-49b9-bda7-ee1e6153c5cd tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:09.944945 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-037154b3-7ec0-49b9-bda7-ee1e6153c5cd tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:09.961435 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-037154b3-7ec0-49b9-bda7-ee1e6153c5cd tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:09.962112 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-037154b3-7ec0-49b9-bda7-ee1e6153c5cd tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:09.963600 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-037154b3-7ec0-49b9-bda7-ee1e6153c5cd tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:09.964535 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-037154b3-7ec0-49b9-bda7-ee1e6153c5cd tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:10.249873 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-037154b3-7ec0-49b9-bda7-ee1e6153c5cd tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:10.257510 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-037154b3-7ec0-49b9-bda7-ee1e6153c5cd tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028" status: 200 len: 1360 microversion: 2.1 time: 0.318738 Feb 15 14:32:10.268742 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 420/846] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:09 2022] GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028 => generated 1360 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:10.619684 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-1e12176a-ab88-4e5b-b548-a95ec757fb9e tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:10.620370 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-1e12176a-ab88-4e5b-b548-a95ec757fb9e tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 9675ad13-9333-4efc-8f5d-2a22f16aa74f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:10.628469 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1e12176a-ab88-4e5b-b548-a95ec757fb9e tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:10.629135 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1e12176a-ab88-4e5b-b548-a95ec757fb9e tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:10.630136 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1e12176a-ab88-4e5b-b548-a95ec757fb9e tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:10.630574 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1e12176a-ab88-4e5b-b548-a95ec757fb9e tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:10.642253 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-5866e742-86b6-4854-98d9-e3a9e55d2bcc req-4f782071-dcab-4f4f-a3bf-ae73b30d8c68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06be0107-ce81-44f5-9f69-640c080a2028", "tag": "c104fe38-125e-4096-8dae-a85a359717bb"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:32:10.644869 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:32:10.644869 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:32:10.658011 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-5866e742-86b6-4854-98d9-e3a9e55d2bcc req-4f782071-dcab-4f4f-a3bf-ae73b30d8c68 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:10.658748 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-5866e742-86b6-4854-98d9-e3a9e55d2bcc req-4f782071-dcab-4f4f-a3bf-ae73b30d8c68 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:10.701262 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-5866e742-86b6-4854-98d9-e3a9e55d2bcc req-4f782071-dcab-4f4f-a3bf-ae73b30d8c68 service nova] Creating event network-changed:c104fe38-125e-4096-8dae-a85a359717bb for instance 06be0107-ce81-44f5-9f69-640c080a2028 on hv-cinder-81914 Feb 15 14:32:10.709924 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-5866e742-86b6-4854-98d9-e3a9e55d2bcc req-4f782071-dcab-4f4f-a3bf-ae73b30d8c68 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072477 Feb 15 14:32:10.710583 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 421/847] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:32:10.803262 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-1e12176a-ab88-4e5b-b548-a95ec757fb9e tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:10.814299 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-1e12176a-ab88-4e5b-b548-a95ec757fb9e tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f" status: 200 len: 1265 microversion: 2.1 time: 0.198251 Feb 15 14:32:10.815100 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 427/848] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:10 2022] GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:11.276814 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-07175073-e4ec-4454-b1dc-b53ec3f2c207 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:11.277515 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-07175073-e4ec-4454-b1dc-b53ec3f2c207 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:11.284159 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-07175073-e4ec-4454-b1dc-b53ec3f2c207 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:11.284651 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-07175073-e4ec-4454-b1dc-b53ec3f2c207 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:11.285430 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-07175073-e4ec-4454-b1dc-b53ec3f2c207 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:11.285869 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-07175073-e4ec-4454-b1dc-b53ec3f2c207 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:11.361815 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-edab7b1a-37b4-47cd-a4b6-e947c83bb1a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:11.362620 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-edab7b1a-37b4-47cd-a4b6-e947c83bb1a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:11.368486 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-edab7b1a-37b4-47cd-a4b6-e947c83bb1a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:11.369183 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-edab7b1a-37b4-47cd-a4b6-e947c83bb1a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:11.370028 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-edab7b1a-37b4-47cd-a4b6-e947c83bb1a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:11.370558 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-edab7b1a-37b4-47cd-a4b6-e947c83bb1a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:11.384718 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.wsgi [None req-edab7b1a-37b4-47cd-a4b6-e947c83bb1a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] HTTP exception thrown: Instance 1deaae9b-7503-48ca-a476-5814a26e51e0 could not be found. Feb 15 14:32:11.385485 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-edab7b1a-37b4-47cd-a4b6-e947c83bb1a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Returning 404 to user: Instance 1deaae9b-7503-48ca-a476-5814a26e51e0 could not be found. {{(pid=116363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:32:11.386352 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-edab7b1a-37b4-47cd-a4b6-e947c83bb1a3 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "DELETE /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 404 len: 111 microversion: 2.20 time: 0.028394 Feb 15 14:32:11.387334 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 428/849] 10.222.0.83 () {60 vars in 1279 bytes} [Tue Feb 15 14:32:11 2022] DELETE /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 15 14:32:11.395399 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-9e48ff30-a2a7-419c-be9b-7475506aa3db tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:11.396005 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-9e48ff30-a2a7-419c-be9b-7475506aa3db tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 1deaae9b-7503-48ca-a476-5814a26e51e0] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:11.402933 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9e48ff30-a2a7-419c-be9b-7475506aa3db tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:11.403379 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9e48ff30-a2a7-419c-be9b-7475506aa3db tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:11.404161 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9e48ff30-a2a7-419c-be9b-7475506aa3db tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:11.404633 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9e48ff30-a2a7-419c-be9b-7475506aa3db tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:11.418448 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.wsgi [None req-9e48ff30-a2a7-419c-be9b-7475506aa3db tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] HTTP exception thrown: Instance 1deaae9b-7503-48ca-a476-5814a26e51e0 could not be found. Feb 15 14:32:11.419034 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-9e48ff30-a2a7-419c-be9b-7475506aa3db tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Returning 404 to user: Instance 1deaae9b-7503-48ca-a476-5814a26e51e0 could not be found. {{(pid=116363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:32:11.419899 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-9e48ff30-a2a7-419c-be9b-7475506aa3db tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0" status: 404 len: 111 microversion: 2.20 time: 0.028115 Feb 15 14:32:11.420454 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 429/850] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:32:11 2022] GET /compute/v2.1/servers/1deaae9b-7503-48ca-a476-5814a26e51e0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 15 14:32:11.490671 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-07175073-e4ec-4454-b1dc-b53ec3f2c207 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:11.499725 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-07175073-e4ec-4454-b1dc-b53ec3f2c207 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028" status: 200 len: 1360 microversion: 2.1 time: 0.227231 Feb 15 14:32:11.500847 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 422/851] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:11 2022] GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028 => generated 1360 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:11.831803 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-9df67ffa-bcf7-4660-a393-c560a3a9d52d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:11.832447 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-9df67ffa-bcf7-4660-a393-c560a3a9d52d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 9675ad13-9333-4efc-8f5d-2a22f16aa74f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:11.838830 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9df67ffa-bcf7-4660-a393-c560a3a9d52d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:11.839283 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9df67ffa-bcf7-4660-a393-c560a3a9d52d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:11.840062 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9df67ffa-bcf7-4660-a393-c560a3a9d52d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:11.840579 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9df67ffa-bcf7-4660-a393-c560a3a9d52d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:11.973415 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-9df67ffa-bcf7-4660-a393-c560a3a9d52d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:11.980629 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-9df67ffa-bcf7-4660-a393-c560a3a9d52d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f" status: 200 len: 1265 microversion: 2.1 time: 0.152569 Feb 15 14:32:11.981824 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 430/852] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:11 2022] GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:12.517395 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-5b3820db-1ed8-4265-8e0c-97d60889d2cf tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:12.518007 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-5b3820db-1ed8-4265-8e0c-97d60889d2cf tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:12.524558 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5b3820db-1ed8-4265-8e0c-97d60889d2cf tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:12.524946 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5b3820db-1ed8-4265-8e0c-97d60889d2cf tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:12.525715 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5b3820db-1ed8-4265-8e0c-97d60889d2cf tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:12.526146 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5b3820db-1ed8-4265-8e0c-97d60889d2cf tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:12.548215 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-c3014406-2b28-40f2-8a5d-10c223c72c4a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:12.548737 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-c3014406-2b28-40f2-8a5d-10c223c72c4a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:12.554514 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c3014406-2b28-40f2-8a5d-10c223c72c4a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:12.554966 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c3014406-2b28-40f2-8a5d-10c223c72c4a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:12.555744 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c3014406-2b28-40f2-8a5d-10c223c72c4a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:12.556187 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c3014406-2b28-40f2-8a5d-10c223c72c4a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:12.569543 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.wsgi [None req-c3014406-2b28-40f2-8a5d-10c223c72c4a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] HTTP exception thrown: Instance 9c04d927-9f34-4f11-8502-7175a64e3923 could not be found. Feb 15 14:32:12.570147 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-c3014406-2b28-40f2-8a5d-10c223c72c4a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Returning 404 to user: Instance 9c04d927-9f34-4f11-8502-7175a64e3923 could not be found. {{(pid=116363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:32:12.570982 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-c3014406-2b28-40f2-8a5d-10c223c72c4a tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 404 len: 111 microversion: 2.20 time: 0.026842 Feb 15 14:32:12.571576 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 431/853] 10.222.0.83 () {60 vars in 1279 bytes} [Tue Feb 15 14:32:12 2022] DELETE /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 15 14:32:12.579886 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-1cd499a4-448b-45f5-a6c7-302fbe191124 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:12.580530 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-1cd499a4-448b-45f5-a6c7-302fbe191124 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] [instance: 9c04d927-9f34-4f11-8502-7175a64e3923] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:12.586337 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1cd499a4-448b-45f5-a6c7-302fbe191124 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:12.586787 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1cd499a4-448b-45f5-a6c7-302fbe191124 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:12.587574 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1cd499a4-448b-45f5-a6c7-302fbe191124 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:12.588037 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1cd499a4-448b-45f5-a6c7-302fbe191124 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:12.601760 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.wsgi [None req-1cd499a4-448b-45f5-a6c7-302fbe191124 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] HTTP exception thrown: Instance 9c04d927-9f34-4f11-8502-7175a64e3923 could not be found. Feb 15 14:32:12.602354 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-1cd499a4-448b-45f5-a6c7-302fbe191124 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] Returning 404 to user: Instance 9c04d927-9f34-4f11-8502-7175a64e3923 could not be found. {{(pid=116363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:32:12.603186 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-1cd499a4-448b-45f5-a6c7-302fbe191124 tempest-AttachVolumeShelveTestJSON-566146147 tempest-AttachVolumeShelveTestJSON-566146147-project] 10.222.0.83 "GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923" status: 404 len: 111 microversion: 2.20 time: 0.026869 Feb 15 14:32:12.603735 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 432/854] 10.222.0.83 () {60 vars in 1276 bytes} [Tue Feb 15 14:32:12 2022] GET /compute/v2.1/servers/9c04d927-9f34-4f11-8502-7175a64e3923 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 15 14:32:12.661527 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-5b3820db-1ed8-4265-8e0c-97d60889d2cf tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:12.668831 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-5b3820db-1ed8-4265-8e0c-97d60889d2cf tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028" status: 200 len: 1360 microversion: 2.1 time: 0.154979 Feb 15 14:32:12.669708 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 423/855] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:12 2022] GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028 => generated 1360 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:12.998468 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-04f59ad6-a959-4741-b0db-31f74fda8e6d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:12.999076 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-04f59ad6-a959-4741-b0db-31f74fda8e6d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 9675ad13-9333-4efc-8f5d-2a22f16aa74f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:13.005451 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-04f59ad6-a959-4741-b0db-31f74fda8e6d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:13.005902 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-04f59ad6-a959-4741-b0db-31f74fda8e6d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:13.006685 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-04f59ad6-a959-4741-b0db-31f74fda8e6d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:13.007125 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-04f59ad6-a959-4741-b0db-31f74fda8e6d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:13.250261 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-04f59ad6-a959-4741-b0db-31f74fda8e6d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:13.257857 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-04f59ad6-a959-4741-b0db-31f74fda8e6d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f" status: 200 len: 1265 microversion: 2.1 time: 0.263664 Feb 15 14:32:13.258626 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 433/856] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:12 2022] GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:13.685713 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-2b9e2505-244c-4478-b26e-c1ac2f324148 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:13.687093 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-2b9e2505-244c-4478-b26e-c1ac2f324148 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:13.693377 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2b9e2505-244c-4478-b26e-c1ac2f324148 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:13.693831 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2b9e2505-244c-4478-b26e-c1ac2f324148 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:13.694613 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2b9e2505-244c-4478-b26e-c1ac2f324148 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:13.695050 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2b9e2505-244c-4478-b26e-c1ac2f324148 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:13.849578 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-2b9e2505-244c-4478-b26e-c1ac2f324148 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:13.858206 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-2b9e2505-244c-4478-b26e-c1ac2f324148 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028" status: 200 len: 1360 microversion: 2.1 time: 0.176166 Feb 15 14:32:13.860419 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 424/857] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:13 2022] GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028 => generated 1360 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:14.275276 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-a67a6a2c-d8c5-4a67-a865-53e5a4dcae04 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:14.275982 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-a67a6a2c-d8c5-4a67-a865-53e5a4dcae04 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 9675ad13-9333-4efc-8f5d-2a22f16aa74f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:14.283545 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a67a6a2c-d8c5-4a67-a865-53e5a4dcae04 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:14.284011 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a67a6a2c-d8c5-4a67-a865-53e5a4dcae04 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:14.284844 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a67a6a2c-d8c5-4a67-a865-53e5a4dcae04 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:14.285347 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a67a6a2c-d8c5-4a67-a865-53e5a4dcae04 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:14.606906 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a67a6a2c-d8c5-4a67-a865-53e5a4dcae04 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:14.614867 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-a67a6a2c-d8c5-4a67-a865-53e5a4dcae04 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f" status: 200 len: 1265 microversion: 2.1 time: 0.343554 Feb 15 14:32:14.615445 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 434/858] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:14 2022] GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f => generated 1265 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:14.876499 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-d1f6aa45-700f-487b-ad67-df73944bf422 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:14.877965 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-d1f6aa45-700f-487b-ad67-df73944bf422 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:14.884935 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d1f6aa45-700f-487b-ad67-df73944bf422 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:14.885688 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d1f6aa45-700f-487b-ad67-df73944bf422 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:14.886541 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d1f6aa45-700f-487b-ad67-df73944bf422 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:14.887043 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d1f6aa45-700f-487b-ad67-df73944bf422 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:15.102785 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-d1f6aa45-700f-487b-ad67-df73944bf422 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:15.111287 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-d1f6aa45-700f-487b-ad67-df73944bf422 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028" status: 200 len: 1360 microversion: 2.1 time: 0.238248 Feb 15 14:32:15.112037 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 425/859] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:14 2022] GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028 => generated 1360 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:15.632970 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-79538742-bbac-4c1d-b229-945877fcbf24 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:15.633753 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-79538742-bbac-4c1d-b229-945877fcbf24 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 9675ad13-9333-4efc-8f5d-2a22f16aa74f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:15.640826 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-79538742-bbac-4c1d-b229-945877fcbf24 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:15.641405 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-5bab1caa-6f77-4f7f-aa94-c164d57933c6 req-7120d349-8e63-4416-9274-837b2a9c32d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06be0107-ce81-44f5-9f69-640c080a2028", "name": "network-vif-plugged", "status": "completed", "tag": "c104fe38-125e-4096-8dae-a85a359717bb"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:32:15.641641 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-79538742-bbac-4c1d-b229-945877fcbf24 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:15.642588 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-79538742-bbac-4c1d-b229-945877fcbf24 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:15.643108 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:32:15.643108 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:32:15.643331 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-79538742-bbac-4c1d-b229-945877fcbf24 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:15.651346 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-5bab1caa-6f77-4f7f-aa94-c164d57933c6 req-7120d349-8e63-4416-9274-837b2a9c32d2 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:15.651968 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-5bab1caa-6f77-4f7f-aa94-c164d57933c6 req-7120d349-8e63-4416-9274-837b2a9c32d2 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:15.665579 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-5bab1caa-6f77-4f7f-aa94-c164d57933c6 req-7120d349-8e63-4416-9274-837b2a9c32d2 service nova] Creating event network-vif-plugged:c104fe38-125e-4096-8dae-a85a359717bb for instance 06be0107-ce81-44f5-9f69-640c080a2028 on hv-cinder-81914 Feb 15 14:32:15.671143 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-5bab1caa-6f77-4f7f-aa94-c164d57933c6 req-7120d349-8e63-4416-9274-837b2a9c32d2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036077 Feb 15 14:32:15.672240 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 426/860] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:32:15.855027 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-79538742-bbac-4c1d-b229-945877fcbf24 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:15.879674 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-79538742-bbac-4c1d-b229-945877fcbf24 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f" status: 200 len: 1265 microversion: 2.1 time: 0.248011 Feb 15 14:32:15.881714 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 435/861] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:15 2022] GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:16.128642 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-9d5ef995-6f70-4761-bb03-c9e34635ad5e tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:16.129917 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-9d5ef995-6f70-4761-bb03-c9e34635ad5e tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:16.136441 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9d5ef995-6f70-4761-bb03-c9e34635ad5e tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:16.136929 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9d5ef995-6f70-4761-bb03-c9e34635ad5e tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:16.138482 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9d5ef995-6f70-4761-bb03-c9e34635ad5e tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:16.138918 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9d5ef995-6f70-4761-bb03-c9e34635ad5e tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:16.428937 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-9d5ef995-6f70-4761-bb03-c9e34635ad5e tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:16.441547 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-9d5ef995-6f70-4761-bb03-c9e34635ad5e tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028" status: 200 len: 1360 microversion: 2.1 time: 0.316894 Feb 15 14:32:16.449135 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 427/862] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:16 2022] GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028 => generated 1360 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:16.898120 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-4bc4ce05-d665-4479-90bd-c29cf54e996f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:16.898854 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-4bc4ce05-d665-4479-90bd-c29cf54e996f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 9675ad13-9333-4efc-8f5d-2a22f16aa74f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:16.906023 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4bc4ce05-d665-4479-90bd-c29cf54e996f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:16.906550 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4bc4ce05-d665-4479-90bd-c29cf54e996f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:16.907480 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4bc4ce05-d665-4479-90bd-c29cf54e996f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:16.907992 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4bc4ce05-d665-4479-90bd-c29cf54e996f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:17.046566 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-4bc4ce05-d665-4479-90bd-c29cf54e996f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:17.053948 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-4bc4ce05-d665-4479-90bd-c29cf54e996f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f" status: 200 len: 1265 microversion: 2.1 time: 0.159769 Feb 15 14:32:17.063957 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 436/863] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:16 2022] GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:17.460079 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-3ffb2f6b-e4ed-4a85-a0d0-0950f1fc2950 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:17.460853 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-3ffb2f6b-e4ed-4a85-a0d0-0950f1fc2950 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:17.467255 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3ffb2f6b-e4ed-4a85-a0d0-0950f1fc2950 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:17.467880 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3ffb2f6b-e4ed-4a85-a0d0-0950f1fc2950 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:17.468839 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3ffb2f6b-e4ed-4a85-a0d0-0950f1fc2950 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:17.469347 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3ffb2f6b-e4ed-4a85-a0d0-0950f1fc2950 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:17.612686 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-3ffb2f6b-e4ed-4a85-a0d0-0950f1fc2950 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:17.620118 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-3ffb2f6b-e4ed-4a85-a0d0-0950f1fc2950 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028" status: 200 len: 1545 microversion: 2.1 time: 0.164871 Feb 15 14:32:17.621044 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 428/864] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:17 2022] GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028 => generated 1545 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:17.638674 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-56adb678-f20e-4f65-9592-a2096ec49c83 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:17.639391 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-56adb678-f20e-4f65-9592-a2096ec49c83 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:17.645616 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-56adb678-f20e-4f65-9592-a2096ec49c83 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:17.646498 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-56adb678-f20e-4f65-9592-a2096ec49c83 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:17.647533 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-56adb678-f20e-4f65-9592-a2096ec49c83 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:17.648223 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-56adb678-f20e-4f65-9592-a2096ec49c83 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:17.735014 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-56adb678-f20e-4f65-9592-a2096ec49c83 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101348 Feb 15 14:32:17.735883 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 437/865] 10.222.0.83 () {58 vars in 1274 bytes} [Tue Feb 15 14:32:17 2022] GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:32:18.071197 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-189fbffb-3a79-49c5-a0b4-724be5f98f55 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:18.072138 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-189fbffb-3a79-49c5-a0b4-724be5f98f55 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 9675ad13-9333-4efc-8f5d-2a22f16aa74f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:18.078153 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-189fbffb-3a79-49c5-a0b4-724be5f98f55 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:18.078848 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-189fbffb-3a79-49c5-a0b4-724be5f98f55 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:18.079749 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-189fbffb-3a79-49c5-a0b4-724be5f98f55 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:18.080297 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-189fbffb-3a79-49c5-a0b4-724be5f98f55 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:18.221619 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-189fbffb-3a79-49c5-a0b4-724be5f98f55 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:18.229272 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-189fbffb-3a79-49c5-a0b4-724be5f98f55 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f" status: 200 len: 1265 microversion: 2.1 time: 0.161799 Feb 15 14:32:18.229849 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 429/866] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:18 2022] GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:18.722636 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-46dd63c3-f58c-4d22-9f00-41a85cce4c6a tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:18.723164 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-46dd63c3-f58c-4d22-9f00-41a85cce4c6a tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:18.725726 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-fe74d57b-3b2c-4865-8e7e-c5b04dab16c3 req-3659bc54-45b1-4a30-95b8-1626ebf93605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06be0107-ce81-44f5-9f69-640c080a2028", "tag": "c104fe38-125e-4096-8dae-a85a359717bb"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:32:18.727342 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:32:18.727342 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:32:18.729400 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-46dd63c3-f58c-4d22-9f00-41a85cce4c6a tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:18.730034 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-46dd63c3-f58c-4d22-9f00-41a85cce4c6a tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:18.731657 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-46dd63c3-f58c-4d22-9f00-41a85cce4c6a tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:18.732077 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-46dd63c3-f58c-4d22-9f00-41a85cce4c6a tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:18.735965 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-fe74d57b-3b2c-4865-8e7e-c5b04dab16c3 req-3659bc54-45b1-4a30-95b8-1626ebf93605 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:18.736647 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-fe74d57b-3b2c-4865-8e7e-c5b04dab16c3 req-3659bc54-45b1-4a30-95b8-1626ebf93605 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:18.758391 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-fe74d57b-3b2c-4865-8e7e-c5b04dab16c3 req-3659bc54-45b1-4a30-95b8-1626ebf93605 service nova] Creating event network-changed:c104fe38-125e-4096-8dae-a85a359717bb for instance 06be0107-ce81-44f5-9f69-640c080a2028 on hv-cinder-81914 Feb 15 14:32:18.763376 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-46dd63c3-f58c-4d22-9f00-41a85cce4c6a tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/ips" status: 200 len: 105 microversion: 2.1 time: 0.045291 Feb 15 14:32:18.763563 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-fe74d57b-3b2c-4865-8e7e-c5b04dab16c3 req-3659bc54-45b1-4a30-95b8-1626ebf93605 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042095 Feb 15 14:32:18.764872 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 430/868] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:32:18.765015 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 438/868] 10.222.0.83 () {58 vars in 1247 bytes} [Tue Feb 15 14:32:18 2022] GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/ips => generated 105 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:32:18.945626 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-314036d7-a559-459d-80c8-c811ce52f150 tempest-VolumesTestJSON-679545677 tempest-VolumesTestJSON-679545677-project] Calling method '.version_select at 0x7fd74f59c280>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:19.003156 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-314036d7-a559-459d-80c8-c811ce52f150 tempest-VolumesTestJSON-679545677 tempest-VolumesTestJSON-679545677-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/87c73984-4bcc-481e-9ab5-6ab83c5faff5" status: 200 len: 350 microversion: 2.1 time: 0.061387 Feb 15 14:32:19.003915 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 431/869] 10.222.0.83 () {58 vars in 1244 bytes} [Tue Feb 15 14:32:18 2022] GET /compute/v2.1/os-volumes/87c73984-4bcc-481e-9ab5-6ab83c5faff5 => generated 350 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:32:19.253935 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-f9f785ac-015b-4ae6-9b27-1bd038a20629 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:19.255671 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-f9f785ac-015b-4ae6-9b27-1bd038a20629 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 9675ad13-9333-4efc-8f5d-2a22f16aa74f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:19.269379 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f9f785ac-015b-4ae6-9b27-1bd038a20629 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:19.270645 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f9f785ac-015b-4ae6-9b27-1bd038a20629 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:19.272664 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f9f785ac-015b-4ae6-9b27-1bd038a20629 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:19.273780 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f9f785ac-015b-4ae6-9b27-1bd038a20629 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:19.514775 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-f9f785ac-015b-4ae6-9b27-1bd038a20629 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:19.525346 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-f9f785ac-015b-4ae6-9b27-1bd038a20629 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f" status: 200 len: 1265 microversion: 2.1 time: 0.282671 Feb 15 14:32:19.527104 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 439/870] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:19 2022] GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:19.701190 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-02a8de8c-7aee-40cd-9dde-e0724021ac8e req-0bf039f8-6e26-4c35-af00-edfe702b1dcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9675ad13-9333-4efc-8f5d-2a22f16aa74f", "name": "network-vif-plugged", "status": "completed", "tag": "53f4cc4e-a4dd-4cdd-87a5-4465c9f43dc1"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:32:19.704088 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:32:19.704088 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:32:19.717159 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-02a8de8c-7aee-40cd-9dde-e0724021ac8e req-0bf039f8-6e26-4c35-af00-edfe702b1dcc service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:19.717909 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-02a8de8c-7aee-40cd-9dde-e0724021ac8e req-0bf039f8-6e26-4c35-af00-edfe702b1dcc service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:19.742643 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-02a8de8c-7aee-40cd-9dde-e0724021ac8e req-0bf039f8-6e26-4c35-af00-edfe702b1dcc service nova] Creating event network-vif-plugged:53f4cc4e-a4dd-4cdd-87a5-4465c9f43dc1 for instance 9675ad13-9333-4efc-8f5d-2a22f16aa74f on hv-cinder-81914 Feb 15 14:32:19.752838 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-02a8de8c-7aee-40cd-9dde-e0724021ac8e req-0bf039f8-6e26-4c35-af00-edfe702b1dcc service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058484 Feb 15 14:32:19.753658 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 432/871] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:32:20.179319 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-05fadc66-8d3f-4c9c-9fdb-97f389394914 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62d316c6-a66d-4485-9df8-f36881f4c889"}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:32:20.180469 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-05fadc66-8d3f-4c9c-9fdb-97f389394914 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:20.187176 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-05fadc66-8d3f-4c9c-9fdb-97f389394914 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:20.187631 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-05fadc66-8d3f-4c9c-9fdb-97f389394914 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:20.188425 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-05fadc66-8d3f-4c9c-9fdb-97f389394914 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:20.188871 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-05fadc66-8d3f-4c9c-9fdb-97f389394914 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:20.419622 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-05fadc66-8d3f-4c9c-9fdb-97f389394914 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "POST /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.243880 Feb 15 14:32:20.420331 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 440/872] 10.222.0.83 () {60 vars in 1322 bytes} [Tue Feb 15 14:32:20 2022] POST /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/os-volume_attachments => generated 194 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:32:20.493075 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-4daec235-6a09-4737-8b7d-bcb0fe1c47ce tempest-VolumesTestJSON-679545677 tempest-VolumesTestJSON-679545677-project] Calling method '.version_select at 0x7fd74f5e00d0>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:20.540181 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-4daec235-6a09-4737-8b7d-bcb0fe1c47ce tempest-VolumesTestJSON-679545677 tempest-VolumesTestJSON-679545677-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/df7e8d8e-2e4e-402c-960d-4c1943a8be56" status: 200 len: 350 microversion: 2.1 time: 0.050928 Feb 15 14:32:20.540943 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 433/873] 10.222.0.83 () {58 vars in 1244 bytes} [Tue Feb 15 14:32:20 2022] GET /compute/v2.1/os-volumes/df7e8d8e-2e4e-402c-960d-4c1943a8be56 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:32:20.544384 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-db6f9be7-6347-42c4-86ad-3536e82912e1 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:20.545227 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-db6f9be7-6347-42c4-86ad-3536e82912e1 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 9675ad13-9333-4efc-8f5d-2a22f16aa74f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:20.551777 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-db6f9be7-6347-42c4-86ad-3536e82912e1 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:20.552505 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-db6f9be7-6347-42c4-86ad-3536e82912e1 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:20.553397 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-db6f9be7-6347-42c4-86ad-3536e82912e1 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:20.553954 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-db6f9be7-6347-42c4-86ad-3536e82912e1 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:20.706445 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-db6f9be7-6347-42c4-86ad-3536e82912e1 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:20.716211 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-db6f9be7-6347-42c4-86ad-3536e82912e1 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f" status: 200 len: 1265 microversion: 2.1 time: 0.176606 Feb 15 14:32:20.716887 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 441/874] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:20 2022] GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:32:21.733867 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-75e2deae-e685-477e-bcf2-e18f13a22092 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:21.734553 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-75e2deae-e685-477e-bcf2-e18f13a22092 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 9675ad13-9333-4efc-8f5d-2a22f16aa74f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:21.741019 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-75e2deae-e685-477e-bcf2-e18f13a22092 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:21.741464 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-75e2deae-e685-477e-bcf2-e18f13a22092 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:21.742237 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-75e2deae-e685-477e-bcf2-e18f13a22092 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:21.742666 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-75e2deae-e685-477e-bcf2-e18f13a22092 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:21.851745 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-741a1516-ee4f-4fc6-8710-d9c13ef0fff8 tempest-VolumesTestJSON-679545677 tempest-VolumesTestJSON-679545677-project] Calling method '.version_select at 0x7fd74f6ec5e0>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:21.886104 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-75e2deae-e685-477e-bcf2-e18f13a22092 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:21.893980 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-75e2deae-e685-477e-bcf2-e18f13a22092 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f" status: 200 len: 1452 microversion: 2.1 time: 0.164344 Feb 15 14:32:21.894539 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 434/875] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:21 2022] GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:21.899059 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-741a1516-ee4f-4fc6-8710-d9c13ef0fff8 tempest-VolumesTestJSON-679545677 tempest-VolumesTestJSON-679545677-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/eee22cfa-0dff-48d3-a446-46ff73b4b5ad" status: 200 len: 350 microversion: 2.1 time: 0.050869 Feb 15 14:32:21.899631 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 442/876] 10.222.0.83 () {58 vars in 1244 bytes} [Tue Feb 15 14:32:21 2022] GET /compute/v2.1/os-volumes/eee22cfa-0dff-48d3-a446-46ff73b4b5ad => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:32:21.910430 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-cd1215af-a145-4148-9d30-d47a441e599d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:21.910966 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-5161bf37-503f-4d92-83a0-1a92e70d963d tempest-VolumesTestJSON-679545677 tempest-VolumesTestJSON-679545677-project] Calling method '.version_select at 0x7fd74f6f9ee0>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:21.911216 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-cd1215af-a145-4148-9d30-d47a441e599d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 9675ad13-9333-4efc-8f5d-2a22f16aa74f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:21.917160 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cd1215af-a145-4148-9d30-d47a441e599d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:21.917676 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cd1215af-a145-4148-9d30-d47a441e599d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:21.919373 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cd1215af-a145-4148-9d30-d47a441e599d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:21.919811 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cd1215af-a145-4148-9d30-d47a441e599d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:21.990638 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-5161bf37-503f-4d92-83a0-1a92e70d963d tempest-VolumesTestJSON-679545677 tempest-VolumesTestJSON-679545677-project] 10.222.0.83 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.083080 Feb 15 14:32:21.991301 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 443/877] 10.222.0.83 () {58 vars in 1133 bytes} [Tue Feb 15 14:32:21 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:32:22.003278 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-474a408a-fff5-4bc8-af1a-b08ae5a1cb55 tempest-VolumesTestJSON-679545677 tempest-VolumesTestJSON-679545677-project] Calling method '.version_select at 0x7fd74f71e280>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:22.054920 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-cd1215af-a145-4148-9d30-d47a441e599d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:32:22.063146 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-cd1215af-a145-4148-9d30-d47a441e599d tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f" status: 200 len: 1452 microversion: 2.1 time: 0.156295 Feb 15 14:32:22.063719 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 435/878] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:32:21 2022] GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:22.086438 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-474a408a-fff5-4bc8-af1a-b08ae5a1cb55 tempest-VolumesTestJSON-679545677 tempest-VolumesTestJSON-679545677-project] 10.222.0.83 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.086649 Feb 15 14:32:22.087098 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 444/879] 10.222.0.83 () {58 vars in 1148 bytes} [Tue Feb 15 14:32:21 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:32:22.099262 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-565c6c53-e3b5-4ac1-b70c-24c571b0a516 tempest-VolumesTestJSON-679545677 tempest-VolumesTestJSON-679545677-project] Calling method '.version_select at 0x7fd74fefea60>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:22.180156 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-565c6c53-e3b5-4ac1-b70c-24c571b0a516 tempest-VolumesTestJSON-679545677 tempest-VolumesTestJSON-679545677-project] 10.222.0.83 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.084323 Feb 15 14:32:22.180859 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 436/880] 10.222.0.83 () {58 vars in 1133 bytes} [Tue Feb 15 14:32:22 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:22.191796 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-d23eafab-acec-4eb5-92a6-253ffe344beb tempest-VolumesTestJSON-679545677 tempest-VolumesTestJSON-679545677-project] Calling method '.version_select at 0x7fd74f70d670>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:22.270111 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-d23eafab-acec-4eb5-92a6-253ffe344beb tempest-VolumesTestJSON-679545677 tempest-VolumesTestJSON-679545677-project] 10.222.0.83 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.081676 Feb 15 14:32:22.271080 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 445/881] 10.222.0.83 () {58 vars in 1166 bytes} [Tue Feb 15 14:32:22 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:32:22.283592 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-68f8766e-505a-4341-aec2-ffa562f46243 tempest-VolumesTestJSON-679545677 tempest-VolumesTestJSON-679545677-project] Calling method '.version_select at 0x7fd74f58bf70>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:22.362879 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-68f8766e-505a-4341-aec2-ffa562f46243 tempest-VolumesTestJSON-679545677 tempest-VolumesTestJSON-679545677-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.083119 Feb 15 14:32:22.363511 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 437/882] 10.222.0.83 () {58 vars in 1169 bytes} [Tue Feb 15 14:32:22 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:32:22.375842 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-2cfeb200-75ac-4648-ba9e-bc396615194c tempest-VolumesTestJSON-679545677 tempest-VolumesTestJSON-679545677-project] Calling method '.version_select at 0x7fd74f709280>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:22.456429 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-2cfeb200-75ac-4648-ba9e-bc396615194c tempest-VolumesTestJSON-679545677 tempest-VolumesTestJSON-679545677-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.084646 Feb 15 14:32:22.457132 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 446/883] 10.222.0.83 () {58 vars in 1154 bytes} [Tue Feb 15 14:32:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:22.468632 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-8102b4f4-841f-4a8e-8057-771435066e22 tempest-VolumesTestJSON-679545677 tempest-VolumesTestJSON-679545677-project] Calling method '.version_select at 0x7fd74f5619d0>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:22.553241 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-8102b4f4-841f-4a8e-8057-771435066e22 tempest-VolumesTestJSON-679545677 tempest-VolumesTestJSON-679545677-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088639 Feb 15 14:32:22.554007 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 438/884] 10.222.0.83 () {58 vars in 1187 bytes} [Tue Feb 15 14:32:22 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:32:22.567480 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-52f82f31-7551-4fbb-9187-25ec193f075e tempest-VolumesTestJSON-679545677 tempest-VolumesTestJSON-679545677-project] Calling method '.version_select at 0x7fd74f726700>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:22.646758 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-52f82f31-7551-4fbb-9187-25ec193f075e tempest-VolumesTestJSON-679545677 tempest-VolumesTestJSON-679545677-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.083044 Feb 15 14:32:22.647468 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 447/885] 10.222.0.83 () {58 vars in 1154 bytes} [Tue Feb 15 14:32:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:32:23.701127 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-02f4e3b0-8131-4db0-90a5-65875e37fdf5 req-39fdcf52-cc7b-4d5b-b092-8b2b92dc57af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9675ad13-9333-4efc-8f5d-2a22f16aa74f", "tag": "53f4cc4e-a4dd-4cdd-87a5-4465c9f43dc1"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:32:23.702636 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:32:23.702636 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:32:23.709543 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-02f4e3b0-8131-4db0-90a5-65875e37fdf5 req-39fdcf52-cc7b-4d5b-b092-8b2b92dc57af service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:23.709985 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-02f4e3b0-8131-4db0-90a5-65875e37fdf5 req-39fdcf52-cc7b-4d5b-b092-8b2b92dc57af service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:23.720373 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-02f4e3b0-8131-4db0-90a5-65875e37fdf5 req-39fdcf52-cc7b-4d5b-b092-8b2b92dc57af service nova] Creating event network-changed:53f4cc4e-a4dd-4cdd-87a5-4465c9f43dc1 for instance 9675ad13-9333-4efc-8f5d-2a22f16aa74f on hv-cinder-81914 Feb 15 14:32:23.725304 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-02f4e3b0-8131-4db0-90a5-65875e37fdf5 req-39fdcf52-cc7b-4d5b-b092-8b2b92dc57af service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028497 Feb 15 14:32:23.725884 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 439/886] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:32:27.918792 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-1c672a81-33fa-4880-899d-86911eb34a47 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:27.919681 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-1c672a81-33fa-4880-899d-86911eb34a47 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:27.927558 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1c672a81-33fa-4880-899d-86911eb34a47 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:27.928014 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1c672a81-33fa-4880-899d-86911eb34a47 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:27.928980 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1c672a81-33fa-4880-899d-86911eb34a47 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:27.929420 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1c672a81-33fa-4880-899d-86911eb34a47 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:27.960182 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-1c672a81-33fa-4880-899d-86911eb34a47 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045575 Feb 15 14:32:27.960978 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 448/887] 10.222.0.83 () {58 vars in 1301 bytes} [Tue Feb 15 14:32:27 2022] GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:32:27.971735 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-16ae51ba-4538-4443-aba2-fe9c405eff6e tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:27.972320 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-16ae51ba-4538-4443-aba2-fe9c405eff6e tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:27.978778 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-16ae51ba-4538-4443-aba2-fe9c405eff6e tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:27.979235 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-16ae51ba-4538-4443-aba2-fe9c405eff6e tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:27.980047 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-16ae51ba-4538-4443-aba2-fe9c405eff6e tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:27.980518 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-16ae51ba-4538-4443-aba2-fe9c405eff6e tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:28.010095 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-16ae51ba-4538-4443-aba2-fe9c405eff6e tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/os-volume_attachments/62d316c6-a66d-4485-9df8-f36881f4c889" status: 200 len: 194 microversion: 2.1 time: 0.042900 Feb 15 14:32:28.010719 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 440/888] 10.222.0.83 () {58 vars in 1412 bytes} [Tue Feb 15 14:32:27 2022] GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/os-volume_attachments/62d316c6-a66d-4485-9df8-f36881f4c889 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:32:29.318309 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-2f102fd1-e74e-48a4-a9de-d4d325e1a437 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe7ec420-c491-4f66-9e9c-ba2bde9a8562"}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:32:29.319356 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-2f102fd1-e74e-48a4-a9de-d4d325e1a437 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:29.326375 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2f102fd1-e74e-48a4-a9de-d4d325e1a437 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:29.326821 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2f102fd1-e74e-48a4-a9de-d4d325e1a437 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:29.327642 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2f102fd1-e74e-48a4-a9de-d4d325e1a437 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:29.328085 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2f102fd1-e74e-48a4-a9de-d4d325e1a437 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:29.564193 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-2f102fd1-e74e-48a4-a9de-d4d325e1a437 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "POST /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249504 Feb 15 14:32:29.564843 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 449/889] 10.222.0.83 () {60 vars in 1322 bytes} [Tue Feb 15 14:32:29 2022] POST /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:32:37.028806 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-9979dfe4-f13a-490d-9b01-8a44ccec6c8f tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:32:37.029735 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-9979dfe4-f13a-490d-9b01-8a44ccec6c8f tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:32:37.036026 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9979dfe4-f13a-490d-9b01-8a44ccec6c8f tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:37.036504 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9979dfe4-f13a-490d-9b01-8a44ccec6c8f tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:37.037300 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9979dfe4-f13a-490d-9b01-8a44ccec6c8f tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:32:37.038175 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9979dfe4-f13a-490d-9b01-8a44ccec6c8f tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:32:37.069512 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-9979dfe4-f13a-490d-9b01-8a44ccec6c8f tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044997 Feb 15 14:32:37.070069 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 441/890] 10.222.0.83 () {58 vars in 1301 bytes} [Tue Feb 15 14:32:37 2022] GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:33:07.154532 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-377ddcbc-763f-4725-977f-8271774ca9d0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:07.155123 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-377ddcbc-763f-4725-977f-8271774ca9d0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:07.161154 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-377ddcbc-763f-4725-977f-8271774ca9d0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:07.161628 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-377ddcbc-763f-4725-977f-8271774ca9d0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:07.162395 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-377ddcbc-763f-4725-977f-8271774ca9d0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:07.162831 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-377ddcbc-763f-4725-977f-8271774ca9d0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:07.193420 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-377ddcbc-763f-4725-977f-8271774ca9d0 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/os-volume_attachments/62d316c6-a66d-4485-9df8-f36881f4c889" status: 200 len: 194 microversion: 2.1 time: 0.044457 Feb 15 14:33:07.194002 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 450/891] 10.222.0.83 () {58 vars in 1412 bytes} [Tue Feb 15 14:33:07 2022] GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/os-volume_attachments/62d316c6-a66d-4485-9df8-f36881f4c889 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:33:07.204512 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-69c601a9-5e07-4f24-8e05-ac1c0b9e7edb tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:07.205027 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-69c601a9-5e07-4f24-8e05-ac1c0b9e7edb tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:07.211012 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-69c601a9-5e07-4f24-8e05-ac1c0b9e7edb tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:07.211585 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-69c601a9-5e07-4f24-8e05-ac1c0b9e7edb tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:07.212299 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-69c601a9-5e07-4f24-8e05-ac1c0b9e7edb tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:07.212700 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-69c601a9-5e07-4f24-8e05-ac1c0b9e7edb tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:07.289430 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.objects.instance [None req-69c601a9-5e07-4f24-8e05-ac1c0b9e7edb tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lazy-loading 'services' on Instance uuid 06be0107-ce81-44f5-9f69-640c080a2028 {{(pid=116362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:33:07.357296 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-69c601a9-5e07-4f24-8e05-ac1c0b9e7edb tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "DELETE /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/os-volume_attachments/62d316c6-a66d-4485-9df8-f36881f4c889" status: 202 len: 0 microversion: 2.1 time: 0.156633 Feb 15 14:33:07.357907 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 442/892] 10.222.0.83 () {58 vars in 1415 bytes} [Tue Feb 15 14:33:07 2022] DELETE /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/os-volume_attachments/62d316c6-a66d-4485-9df8-f36881f4c889 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:33:08.468292 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-7e91fade-1369-44ab-847c-30c5edee88c4 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:08.468818 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-7e91fade-1369-44ab-847c-30c5edee88c4 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:08.475182 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7e91fade-1369-44ab-847c-30c5edee88c4 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:08.475624 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7e91fade-1369-44ab-847c-30c5edee88c4 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:08.476420 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7e91fade-1369-44ab-847c-30c5edee88c4 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:08.476861 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7e91fade-1369-44ab-847c-30c5edee88c4 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:08.506393 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-7e91fade-1369-44ab-847c-30c5edee88c4 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/os-volume_attachments/fe7ec420-c491-4f66-9e9c-ba2bde9a8562" status: 200 len: 194 microversion: 2.1 time: 0.042403 Feb 15 14:33:08.506966 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 451/893] 10.222.0.83 () {58 vars in 1412 bytes} [Tue Feb 15 14:33:08 2022] GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/os-volume_attachments/fe7ec420-c491-4f66-9e9c-ba2bde9a8562 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:33:08.517030 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-0d763e08-eaed-413b-b42c-9eeafba46e52 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:08.517669 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-0d763e08-eaed-413b-b42c-9eeafba46e52 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:08.524561 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0d763e08-eaed-413b-b42c-9eeafba46e52 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:08.525014 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0d763e08-eaed-413b-b42c-9eeafba46e52 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:08.525794 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0d763e08-eaed-413b-b42c-9eeafba46e52 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:08.526290 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0d763e08-eaed-413b-b42c-9eeafba46e52 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:08.612279 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.objects.instance [None req-0d763e08-eaed-413b-b42c-9eeafba46e52 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lazy-loading 'services' on Instance uuid 06be0107-ce81-44f5-9f69-640c080a2028 {{(pid=116362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:33:08.679497 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-0d763e08-eaed-413b-b42c-9eeafba46e52 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "DELETE /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/os-volume_attachments/fe7ec420-c491-4f66-9e9c-ba2bde9a8562" status: 202 len: 0 microversion: 2.1 time: 0.166341 Feb 15 14:33:08.680099 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 443/894] 10.222.0.83 () {58 vars in 1415 bytes} [Tue Feb 15 14:33:08 2022] DELETE /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/os-volume_attachments/fe7ec420-c491-4f66-9e9c-ba2bde9a8562 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:33:09.842193 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-02478862-08a8-4c97-8755-4269c8341f00 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:09.843495 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-02478862-08a8-4c97-8755-4269c8341f00 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:09.850053 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-02478862-08a8-4c97-8755-4269c8341f00 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:09.850506 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-02478862-08a8-4c97-8755-4269c8341f00 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:09.851283 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-02478862-08a8-4c97-8755-4269c8341f00 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:09.851716 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-02478862-08a8-4c97-8755-4269c8341f00 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:09.881222 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-02478862-08a8-4c97-8755-4269c8341f00 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042927 Feb 15 14:33:09.881792 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 452/895] 10.222.0.83 () {58 vars in 1301 bytes} [Tue Feb 15 14:33:09 2022] GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 14:33:09.986214 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-fcb1ccb0-417e-4152-b764-cd75a192bd00 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:09.987269 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-fcb1ccb0-417e-4152-b764-cd75a192bd00 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:09.993318 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fcb1ccb0-417e-4152-b764-cd75a192bd00 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:09.993764 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fcb1ccb0-417e-4152-b764-cd75a192bd00 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:09.994542 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fcb1ccb0-417e-4152-b764-cd75a192bd00 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:09.994975 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-fcb1ccb0-417e-4152-b764-cd75a192bd00 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:10.025032 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-fcb1ccb0-417e-4152-b764-cd75a192bd00 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043394 Feb 15 14:33:10.025588 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 444/896] 10.222.0.83 () {58 vars in 1301 bytes} [Tue Feb 15 14:33:09 2022] GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 14:33:10.079700 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-a8c55921-b12c-42cd-9714-69f891ddc8ac tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:10.080209 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-a8c55921-b12c-42cd-9714-69f891ddc8ac tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:10.086038 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a8c55921-b12c-42cd-9714-69f891ddc8ac tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:10.086385 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a8c55921-b12c-42cd-9714-69f891ddc8ac tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:10.087162 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a8c55921-b12c-42cd-9714-69f891ddc8ac tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:10.087604 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a8c55921-b12c-42cd-9714-69f891ddc8ac tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:10.112887 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-a8c55921-b12c-42cd-9714-69f891ddc8ac tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Going to try to terminate instance {{(pid=116363) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 14:33:10.190355 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-a8c55921-b12c-42cd-9714-69f891ddc8ac tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "DELETE /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028" status: 204 len: 0 microversion: 2.1 time: 0.113929 Feb 15 14:33:10.194313 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 453/897] 10.222.0.83 () {58 vars in 1238 bytes} [Tue Feb 15 14:33:10 2022] DELETE /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 15 14:33:10.199302 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-7398bfc0-fbf9-4686-bf31-c1e5a8873009 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:10.199931 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-7398bfc0-fbf9-4686-bf31-c1e5a8873009 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:10.205699 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7398bfc0-fbf9-4686-bf31-c1e5a8873009 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:10.206150 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7398bfc0-fbf9-4686-bf31-c1e5a8873009 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:10.206936 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7398bfc0-fbf9-4686-bf31-c1e5a8873009 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:10.207368 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7398bfc0-fbf9-4686-bf31-c1e5a8873009 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:10.341972 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-7398bfc0-fbf9-4686-bf31-c1e5a8873009 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:33:10.349418 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-7398bfc0-fbf9-4686-bf31-c1e5a8873009 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028" status: 200 len: 1669 microversion: 2.1 time: 0.153773 Feb 15 14:33:10.350024 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 445/898] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:33:10 2022] GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028 => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:33:11.367401 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-7157f230-29d6-46a8-aef2-e66e1a71db36 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:11.368114 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-7157f230-29d6-46a8-aef2-e66e1a71db36 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:11.374929 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7157f230-29d6-46a8-aef2-e66e1a71db36 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:11.375382 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7157f230-29d6-46a8-aef2-e66e1a71db36 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:11.376160 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7157f230-29d6-46a8-aef2-e66e1a71db36 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:11.376639 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7157f230-29d6-46a8-aef2-e66e1a71db36 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:11.512972 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-7157f230-29d6-46a8-aef2-e66e1a71db36 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:33:11.520540 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-7157f230-29d6-46a8-aef2-e66e1a71db36 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028" status: 200 len: 1669 microversion: 2.1 time: 0.157210 Feb 15 14:33:11.521111 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 454/899] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:33:11 2022] GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:33:12.537706 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-0830f1e3-88fb-424a-8987-f29d6d9ea3ef tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:12.538340 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-0830f1e3-88fb-424a-8987-f29d6d9ea3ef tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:12.545416 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0830f1e3-88fb-424a-8987-f29d6d9ea3ef tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:12.545865 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0830f1e3-88fb-424a-8987-f29d6d9ea3ef tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:12.546649 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0830f1e3-88fb-424a-8987-f29d6d9ea3ef tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:12.547085 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0830f1e3-88fb-424a-8987-f29d6d9ea3ef tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:12.811175 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-0830f1e3-88fb-424a-8987-f29d6d9ea3ef tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f121c2569f456ba0f2374744491315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa71715dd644b259ad6713b99c6a3d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:33:12.818885 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-0830f1e3-88fb-424a-8987-f29d6d9ea3ef tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028" status: 200 len: 1669 microversion: 2.1 time: 0.284638 Feb 15 14:33:12.819723 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 446/900] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:33:12 2022] GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028 => generated 1669 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:33:13.264815 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-90218f90-e9ec-4713-9762-eca0a674e1ca req-94aa743e-885c-4ae4-8785-bb7364d9d1a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06be0107-ce81-44f5-9f69-640c080a2028", "name": "network-vif-deleted", "tag": "c104fe38-125e-4096-8dae-a85a359717bb"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:33:13.266616 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:33:13.266616 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:33:13.277198 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-90218f90-e9ec-4713-9762-eca0a674e1ca req-94aa743e-885c-4ae4-8785-bb7364d9d1a7 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:13.278527 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-90218f90-e9ec-4713-9762-eca0a674e1ca req-94aa743e-885c-4ae4-8785-bb7364d9d1a7 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:13.294854 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-90218f90-e9ec-4713-9762-eca0a674e1ca req-94aa743e-885c-4ae4-8785-bb7364d9d1a7 service nova] Creating event network-vif-deleted:c104fe38-125e-4096-8dae-a85a359717bb for instance 06be0107-ce81-44f5-9f69-640c080a2028 on hv-cinder-81914 Feb 15 14:33:13.301730 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-90218f90-e9ec-4713-9762-eca0a674e1ca req-94aa743e-885c-4ae4-8785-bb7364d9d1a7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041531 Feb 15 14:33:13.306761 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 455/901] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:33:13.837918 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-39c57f99-64e6-4223-a54a-0c342037cbf4 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:13.838660 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-39c57f99-64e6-4223-a54a-0c342037cbf4 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:13.846646 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-39c57f99-64e6-4223-a54a-0c342037cbf4 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:13.847404 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-39c57f99-64e6-4223-a54a-0c342037cbf4 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:13.848481 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-39c57f99-64e6-4223-a54a-0c342037cbf4 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:13.849159 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-39c57f99-64e6-4223-a54a-0c342037cbf4 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:13.867397 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.wsgi [None req-39c57f99-64e6-4223-a54a-0c342037cbf4 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] HTTP exception thrown: Instance 06be0107-ce81-44f5-9f69-640c080a2028 could not be found. Feb 15 14:33:13.867955 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-39c57f99-64e6-4223-a54a-0c342037cbf4 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Returning 404 to user: Instance 06be0107-ce81-44f5-9f69-640c080a2028 could not be found. {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:33:13.869153 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-39c57f99-64e6-4223-a54a-0c342037cbf4 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028" status: 404 len: 111 microversion: 2.1 time: 0.036837 Feb 15 14:33:13.873700 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 447/902] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:33:13 2022] GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:33:13.884169 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-efacf4b5-4573-4636-afee-8d629d8d850d tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '.version_select at 0x7fd74f51ca60>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:13.903861 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-efacf4b5-4573-4636-afee-8d629d8d850d tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774728001" status: 202 len: 0 microversion: 2.1 time: 0.027539 Feb 15 14:33:13.904593 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 456/903] 10.222.0.83 () {58 vars in 1220 bytes} [Tue Feb 15 14:33:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774728001 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:33:16.846162 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-301005ad-ad12-45b3-9908-ec30223e754c tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:16.846667 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-301005ad-ad12-45b3-9908-ec30223e754c tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:16.852977 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-301005ad-ad12-45b3-9908-ec30223e754c tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:16.853434 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-301005ad-ad12-45b3-9908-ec30223e754c tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:16.854217 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-301005ad-ad12-45b3-9908-ec30223e754c tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:16.854660 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-301005ad-ad12-45b3-9908-ec30223e754c tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:16.868288 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.wsgi [None req-301005ad-ad12-45b3-9908-ec30223e754c tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] HTTP exception thrown: Instance 06be0107-ce81-44f5-9f69-640c080a2028 could not be found. Feb 15 14:33:16.868909 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-301005ad-ad12-45b3-9908-ec30223e754c tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Returning 404 to user: Instance 06be0107-ce81-44f5-9f69-640c080a2028 could not be found. {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:33:16.869730 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-301005ad-ad12-45b3-9908-ec30223e754c tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "DELETE /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028" status: 404 len: 111 microversion: 2.1 time: 0.027215 Feb 15 14:33:16.870496 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 448/904] 10.222.0.83 () {58 vars in 1238 bytes} [Tue Feb 15 14:33:16 2022] DELETE /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:33:16.880194 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-9bc4dd40-68e2-4cd7-b3c3-2442f75390e7 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:16.881089 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-9bc4dd40-68e2-4cd7-b3c3-2442f75390e7 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: 06be0107-ce81-44f5-9f69-640c080a2028] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:16.887350 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9bc4dd40-68e2-4cd7-b3c3-2442f75390e7 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:16.887953 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9bc4dd40-68e2-4cd7-b3c3-2442f75390e7 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:16.888831 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9bc4dd40-68e2-4cd7-b3c3-2442f75390e7 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:16.889332 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-9bc4dd40-68e2-4cd7-b3c3-2442f75390e7 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:16.902589 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.wsgi [None req-9bc4dd40-68e2-4cd7-b3c3-2442f75390e7 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] HTTP exception thrown: Instance 06be0107-ce81-44f5-9f69-640c080a2028 could not be found. Feb 15 14:33:16.903382 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-9bc4dd40-68e2-4cd7-b3c3-2442f75390e7 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Returning 404 to user: Instance 06be0107-ce81-44f5-9f69-640c080a2028 could not be found. {{(pid=116363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:33:16.904207 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-9bc4dd40-68e2-4cd7-b3c3-2442f75390e7 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028" status: 404 len: 111 microversion: 2.1 time: 0.028166 Feb 15 14:33:16.904792 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 457/905] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:33:16 2022] GET /compute/v2.1/servers/06be0107-ce81-44f5-9f69-640c080a2028 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:33:18.032748 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-f3323d2c-4728-4dfc-af4e-b1c8178902b6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:18.033331 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-f3323d2c-4728-4dfc-af4e-b1c8178902b6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:18.039609 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f3323d2c-4728-4dfc-af4e-b1c8178902b6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:18.040066 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f3323d2c-4728-4dfc-af4e-b1c8178902b6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:18.040884 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f3323d2c-4728-4dfc-af4e-b1c8178902b6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:18.041818 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f3323d2c-4728-4dfc-af4e-b1c8178902b6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:18.056352 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.wsgi [None req-f3323d2c-4728-4dfc-af4e-b1c8178902b6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] HTTP exception thrown: Instance db561480-36d5-4879-aa89-d62bf3623851 could not be found. Feb 15 14:33:18.056997 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-f3323d2c-4728-4dfc-af4e-b1c8178902b6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Returning 404 to user: Instance db561480-36d5-4879-aa89-d62bf3623851 could not be found. {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:33:18.057832 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-f3323d2c-4728-4dfc-af4e-b1c8178902b6 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "DELETE /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 404 len: 111 microversion: 2.1 time: 0.028855 Feb 15 14:33:18.058391 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 449/906] 10.222.0.83 () {58 vars in 1238 bytes} [Tue Feb 15 14:33:18 2022] DELETE /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:33:18.066254 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-714ab99a-709e-4cbe-8803-40c27a4d1a89 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:18.066865 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-714ab99a-709e-4cbe-8803-40c27a4d1a89 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] [instance: db561480-36d5-4879-aa89-d62bf3623851] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:18.073077 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-714ab99a-709e-4cbe-8803-40c27a4d1a89 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:18.073527 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-714ab99a-709e-4cbe-8803-40c27a4d1a89 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:18.074455 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-714ab99a-709e-4cbe-8803-40c27a4d1a89 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:18.075073 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-714ab99a-709e-4cbe-8803-40c27a4d1a89 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:18.088077 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.wsgi [None req-714ab99a-709e-4cbe-8803-40c27a4d1a89 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] HTTP exception thrown: Instance db561480-36d5-4879-aa89-d62bf3623851 could not be found. Feb 15 14:33:18.088680 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-714ab99a-709e-4cbe-8803-40c27a4d1a89 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] Returning 404 to user: Instance db561480-36d5-4879-aa89-d62bf3623851 could not be found. {{(pid=116363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:33:18.090001 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-714ab99a-709e-4cbe-8803-40c27a4d1a89 tempest-AttachVolumeTestJSON-1336079164 tempest-AttachVolumeTestJSON-1336079164-project] 10.222.0.83 "GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851" status: 404 len: 111 microversion: 2.1 time: 0.026969 Feb 15 14:33:18.090551 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 458/907] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:33:18 2022] GET /compute/v2.1/servers/db561480-36d5-4879-aa89-d62bf3623851 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:33:20.945868 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-dcdb0c06-6d6e-40be-9b22-90a7f163399c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-959758924", "imageRef": "da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53", "flavorRef": "452", "networks": [{"uuid": "50b1d3df-2a0e-4293-b2d4-b2ff45bdeb2a"}]}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:33:21.001351 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.network.neutron [None req-dcdb0c06-6d6e-40be-9b22-90a7f163399c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] validate_networks() for [('50b1d3df-2a0e-4293-b2d4-b2ff45bdeb2a', None, None, None, None, None)] {{(pid=116362) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 14:33:21.428726 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-dcdb0c06-6d6e-40be-9b22-90a7f163399c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Flavor limits 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 14:33:21.429399 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-dcdb0c06-6d6e-40be-9b22-90a7f163399c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Image limits 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 14:33:21.430227 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-dcdb0c06-6d6e-40be-9b22-90a7f163399c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Flavor pref 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 14:33:21.431311 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-dcdb0c06-6d6e-40be-9b22-90a7f163399c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Image pref 0:0:0 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 14:33:21.432273 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.virt.hardware [None req-dcdb0c06-6d6e-40be-9b22-90a7f163399c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 14:33:21.442225 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-dcdb0c06-6d6e-40be-9b22-90a7f163399c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:21.442780 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-dcdb0c06-6d6e-40be-9b22-90a7f163399c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:21.443778 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-dcdb0c06-6d6e-40be-9b22-90a7f163399c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:21.444214 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-dcdb0c06-6d6e-40be-9b22-90a7f163399c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:21.469449 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-dcdb0c06-6d6e-40be-9b22-90a7f163399c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Getting quotas for project 8b9494e5cf9042de869b6a3d9505d51e. Resources: {'instances', 'ram', 'cores'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:33:21.474101 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-dcdb0c06-6d6e-40be-9b22-90a7f163399c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Getting quotas for user b91a680236734dddb8c5fd1dfaebd60b and project 8b9494e5cf9042de869b6a3d9505d51e. Resources: {'instances', 'ram', 'cores'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:33:21.490910 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-dcdb0c06-6d6e-40be-9b22-90a7f163399c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Going to run 1 instances... {{(pid=116362) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 14:33:21.493580 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-dcdb0c06-6d6e-40be-9b22-90a7f163399c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 14:33:21.546746 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dcdb0c06-6d6e-40be-9b22-90a7f163399c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [e26fc338-6dca-4083-a738-d3455c520733] AMQP server on 10.222.0.83:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 15 14:33:22.555488 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO oslo.messaging._drivers.impl_rabbit [None req-dcdb0c06-6d6e-40be-9b22-90a7f163399c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [e26fc338-6dca-4083-a738-d3455c520733] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 36054. Feb 15 14:33:22.560301 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-dcdb0c06-6d6e-40be-9b22-90a7f163399c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.617811 Feb 15 14:33:22.561067 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 450/908] 10.222.0.83 () {60 vars in 1146 bytes} [Tue Feb 15 14:33:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 14:33:22.571137 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-f2ebf7a6-1510-46fa-a65e-e10e42a394e4 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:22.571765 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-f2ebf7a6-1510-46fa-a65e-e10e42a394e4 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:22.632379 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-f2ebf7a6-1510-46fa-a65e-e10e42a394e4 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:33:22.641462 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-f2ebf7a6-1510-46fa-a65e-e10e42a394e4 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db" status: 200 len: 1218 microversion: 2.1 time: 0.073962 Feb 15 14:33:22.642194 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 459/909] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:33:22 2022] GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:33:23.662980 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-c7530ea8-c18d-4adf-b6f6-38bfc728bce9 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:23.665764 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-c7530ea8-c18d-4adf-b6f6-38bfc728bce9 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:23.674042 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c7530ea8-c18d-4adf-b6f6-38bfc728bce9 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:23.674643 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c7530ea8-c18d-4adf-b6f6-38bfc728bce9 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:23.675629 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c7530ea8-c18d-4adf-b6f6-38bfc728bce9 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:23.676582 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c7530ea8-c18d-4adf-b6f6-38bfc728bce9 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:23.755332 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-c7530ea8-c18d-4adf-b6f6-38bfc728bce9 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:33:23.763341 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-c7530ea8-c18d-4adf-b6f6-38bfc728bce9 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db" status: 200 len: 1276 microversion: 2.1 time: 0.108901 Feb 15 14:33:23.764122 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 451/910] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:33:23 2022] GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db => generated 1276 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:33:24.781670 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-3b00ce82-6e11-47f3-a264-88a4bee8bb14 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:24.782913 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-3b00ce82-6e11-47f3-a264-88a4bee8bb14 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:24.790217 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3b00ce82-6e11-47f3-a264-88a4bee8bb14 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:24.790857 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3b00ce82-6e11-47f3-a264-88a4bee8bb14 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:24.791875 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3b00ce82-6e11-47f3-a264-88a4bee8bb14 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:24.793393 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3b00ce82-6e11-47f3-a264-88a4bee8bb14 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:24.836721 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-2a0b6102-2ae4-49c3-8486-73a739e5f29d req-d7b3c4f3-ad11-419e-b44e-35d116fe0e9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db", "tag": "e811d6de-5b3e-4a58-9f1f-d3c491a3bac1"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:33:24.841864 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:33:24.841864 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:33:24.853790 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-2a0b6102-2ae4-49c3-8486-73a739e5f29d req-d7b3c4f3-ad11-419e-b44e-35d116fe0e9f service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:24.855979 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-2a0b6102-2ae4-49c3-8486-73a739e5f29d req-d7b3c4f3-ad11-419e-b44e-35d116fe0e9f service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:24.869960 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-2a0b6102-2ae4-49c3-8486-73a739e5f29d req-d7b3c4f3-ad11-419e-b44e-35d116fe0e9f service nova] Creating event network-changed:e811d6de-5b3e-4a58-9f1f-d3c491a3bac1 for instance 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db on hv-cinder-81914 Feb 15 14:33:24.883965 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-2a0b6102-2ae4-49c3-8486-73a739e5f29d req-d7b3c4f3-ad11-419e-b44e-35d116fe0e9f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054632 Feb 15 14:33:24.885180 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 452/911] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:33:24.978463 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-3b00ce82-6e11-47f3-a264-88a4bee8bb14 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:33:24.986443 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-3b00ce82-6e11-47f3-a264-88a4bee8bb14 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db" status: 200 len: 1318 microversion: 2.1 time: 0.208473 Feb 15 14:33:24.987222 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 460/912] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:33:24 2022] GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:33:26.003833 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-ea4def9d-80f0-436d-b2ad-101ae7e11563 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:26.004566 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-ea4def9d-80f0-436d-b2ad-101ae7e11563 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:26.011699 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ea4def9d-80f0-436d-b2ad-101ae7e11563 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:26.012177 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ea4def9d-80f0-436d-b2ad-101ae7e11563 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:26.012996 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ea4def9d-80f0-436d-b2ad-101ae7e11563 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:26.013440 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ea4def9d-80f0-436d-b2ad-101ae7e11563 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:26.145448 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-ea4def9d-80f0-436d-b2ad-101ae7e11563 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:33:26.153541 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-ea4def9d-80f0-436d-b2ad-101ae7e11563 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db" status: 200 len: 1318 microversion: 2.1 time: 0.153696 Feb 15 14:33:26.154106 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 453/913] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:33:25 2022] GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:33:27.170131 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-97dd4bc7-8cc7-45db-9f48-05c290c9ed2a tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:27.170812 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-97dd4bc7-8cc7-45db-9f48-05c290c9ed2a tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:27.177658 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-97dd4bc7-8cc7-45db-9f48-05c290c9ed2a tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:27.178237 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-97dd4bc7-8cc7-45db-9f48-05c290c9ed2a tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:27.179241 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-97dd4bc7-8cc7-45db-9f48-05c290c9ed2a tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:27.179750 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-97dd4bc7-8cc7-45db-9f48-05c290c9ed2a tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:27.314399 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-97dd4bc7-8cc7-45db-9f48-05c290c9ed2a tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:33:27.322427 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-97dd4bc7-8cc7-45db-9f48-05c290c9ed2a tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db" status: 200 len: 1318 microversion: 2.1 time: 0.156164 Feb 15 14:33:27.323005 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 461/914] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:33:27 2022] GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:33:28.340555 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-f406d0a7-6271-4c36-933c-06cd114cde10 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:28.341175 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-f406d0a7-6271-4c36-933c-06cd114cde10 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:28.347433 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f406d0a7-6271-4c36-933c-06cd114cde10 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:28.347885 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f406d0a7-6271-4c36-933c-06cd114cde10 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:28.348693 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f406d0a7-6271-4c36-933c-06cd114cde10 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:28.349377 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f406d0a7-6271-4c36-933c-06cd114cde10 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:28.605123 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-f406d0a7-6271-4c36-933c-06cd114cde10 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:33:28.612416 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-f406d0a7-6271-4c36-933c-06cd114cde10 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db" status: 200 len: 1318 microversion: 2.1 time: 0.276877 Feb 15 14:33:28.612992 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 454/915] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:33:28 2022] GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:33:29.628852 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-177d354d-d413-4b91-9548-d9523fad7841 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:29.629488 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-177d354d-d413-4b91-9548-d9523fad7841 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:29.636394 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-177d354d-d413-4b91-9548-d9523fad7841 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:29.636875 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-177d354d-d413-4b91-9548-d9523fad7841 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:29.637662 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-177d354d-d413-4b91-9548-d9523fad7841 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:29.638102 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-177d354d-d413-4b91-9548-d9523fad7841 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:29.773032 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-177d354d-d413-4b91-9548-d9523fad7841 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:33:29.780245 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-177d354d-d413-4b91-9548-d9523fad7841 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db" status: 200 len: 1318 microversion: 2.1 time: 0.155022 Feb 15 14:33:29.780913 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 462/916] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:33:29 2022] GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:33:30.797088 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-2ec74df8-cb1d-4e30-a183-d45af31ccc90 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:30.797695 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-2ec74df8-cb1d-4e30-a183-d45af31ccc90 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:30.803855 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2ec74df8-cb1d-4e30-a183-d45af31ccc90 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:30.804296 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2ec74df8-cb1d-4e30-a183-d45af31ccc90 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:30.805093 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2ec74df8-cb1d-4e30-a183-d45af31ccc90 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:30.805523 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2ec74df8-cb1d-4e30-a183-d45af31ccc90 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:30.938183 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-2ec74df8-cb1d-4e30-a183-d45af31ccc90 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:33:30.945410 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-2ec74df8-cb1d-4e30-a183-d45af31ccc90 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db" status: 200 len: 1318 microversion: 2.1 time: 0.151959 Feb 15 14:33:30.945980 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 455/917] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:33:30 2022] GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:33:31.961946 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-44b13b71-2488-4fb2-b2f6-53fdb1a2b079 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:31.962556 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-44b13b71-2488-4fb2-b2f6-53fdb1a2b079 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:31.969437 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-44b13b71-2488-4fb2-b2f6-53fdb1a2b079 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:31.969879 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-44b13b71-2488-4fb2-b2f6-53fdb1a2b079 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:31.970794 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-44b13b71-2488-4fb2-b2f6-53fdb1a2b079 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:31.971235 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-44b13b71-2488-4fb2-b2f6-53fdb1a2b079 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:32.102521 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-44b13b71-2488-4fb2-b2f6-53fdb1a2b079 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:33:32.109992 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-44b13b71-2488-4fb2-b2f6-53fdb1a2b079 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db" status: 200 len: 1318 microversion: 2.1 time: 0.151736 Feb 15 14:33:32.110564 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 463/918] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:33:31 2022] GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:33:33.127033 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-6d2d065a-5459-4555-a9b5-87a6563ff09d tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:33.127650 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-6d2d065a-5459-4555-a9b5-87a6563ff09d tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:33.133936 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6d2d065a-5459-4555-a9b5-87a6563ff09d tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:33.134378 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6d2d065a-5459-4555-a9b5-87a6563ff09d tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:33.135180 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6d2d065a-5459-4555-a9b5-87a6563ff09d tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:33.135616 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6d2d065a-5459-4555-a9b5-87a6563ff09d tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:33.269604 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-6d2d065a-5459-4555-a9b5-87a6563ff09d tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:33:33.277259 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-6d2d065a-5459-4555-a9b5-87a6563ff09d tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db" status: 200 len: 1318 microversion: 2.1 time: 0.153907 Feb 15 14:33:33.277828 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 456/919] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:33:33 2022] GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:33:34.050005 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-d719dc6b-9ed6-4927-a9e4-b121c2503b9b req-8ab1f5fe-5638-4adf-a9e9-b6906faf2aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db", "name": "network-vif-plugged", "status": "completed", "tag": "e811d6de-5b3e-4a58-9f1f-d3c491a3bac1"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:33:34.051657 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:33:34.051657 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:33:34.060369 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-d719dc6b-9ed6-4927-a9e4-b121c2503b9b req-8ab1f5fe-5638-4adf-a9e9-b6906faf2aa5 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:34.060936 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-d719dc6b-9ed6-4927-a9e4-b121c2503b9b req-8ab1f5fe-5638-4adf-a9e9-b6906faf2aa5 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:34.072289 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-d719dc6b-9ed6-4927-a9e4-b121c2503b9b req-8ab1f5fe-5638-4adf-a9e9-b6906faf2aa5 service nova] Creating event network-vif-plugged:e811d6de-5b3e-4a58-9f1f-d3c491a3bac1 for instance 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db on hv-cinder-81914 Feb 15 14:33:34.077986 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-d719dc6b-9ed6-4927-a9e4-b121c2503b9b req-8ab1f5fe-5638-4adf-a9e9-b6906faf2aa5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031659 Feb 15 14:33:34.078775 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 464/920] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:33:34.293566 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-22275cf7-4ae0-4441-8fd0-9d64f9726a06 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:34.294965 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-22275cf7-4ae0-4441-8fd0-9d64f9726a06 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:34.301282 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-22275cf7-4ae0-4441-8fd0-9d64f9726a06 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:34.301726 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-22275cf7-4ae0-4441-8fd0-9d64f9726a06 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:34.302497 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-22275cf7-4ae0-4441-8fd0-9d64f9726a06 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:34.302926 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-22275cf7-4ae0-4441-8fd0-9d64f9726a06 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:34.437587 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-22275cf7-4ae0-4441-8fd0-9d64f9726a06 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:33:34.444725 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-22275cf7-4ae0-4441-8fd0-9d64f9726a06 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db" status: 200 len: 1318 microversion: 2.1 time: 0.154795 Feb 15 14:33:34.445295 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 457/921] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:33:34 2022] GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:33:35.462501 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-2ade00a3-a610-4c0f-92ee-fb29de6029bb tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:35.463199 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-2ade00a3-a610-4c0f-92ee-fb29de6029bb tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:35.469681 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2ade00a3-a610-4c0f-92ee-fb29de6029bb tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:35.470125 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2ade00a3-a610-4c0f-92ee-fb29de6029bb tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:35.470885 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2ade00a3-a610-4c0f-92ee-fb29de6029bb tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:35.471321 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2ade00a3-a610-4c0f-92ee-fb29de6029bb tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:35.610913 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-2ade00a3-a610-4c0f-92ee-fb29de6029bb tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:33:35.618369 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-2ade00a3-a610-4c0f-92ee-fb29de6029bb tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db" status: 200 len: 1318 microversion: 2.1 time: 0.160052 Feb 15 14:33:35.619132 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 465/922] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:33:35 2022] GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:33:36.637013 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-bd255d6d-7fe3-43f2-8c4b-52fa43429e63 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:36.637804 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-bd255d6d-7fe3-43f2-8c4b-52fa43429e63 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:36.644821 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bd255d6d-7fe3-43f2-8c4b-52fa43429e63 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:36.645270 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bd255d6d-7fe3-43f2-8c4b-52fa43429e63 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:36.646050 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bd255d6d-7fe3-43f2-8c4b-52fa43429e63 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:36.646489 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bd255d6d-7fe3-43f2-8c4b-52fa43429e63 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:36.776339 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-bd255d6d-7fe3-43f2-8c4b-52fa43429e63 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:33:36.783560 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-bd255d6d-7fe3-43f2-8c4b-52fa43429e63 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db" status: 200 len: 1318 microversion: 2.1 time: 0.150882 Feb 15 14:33:36.784127 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 458/923] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:33:36 2022] GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:33:37.800030 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-70e74e8c-56a5-4c89-a9dd-c31102f97469 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:33:37.800663 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-70e74e8c-56a5-4c89-a9dd-c31102f97469 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:37.806895 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-70e74e8c-56a5-4c89-a9dd-c31102f97469 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:37.807337 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-70e74e8c-56a5-4c89-a9dd-c31102f97469 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:37.808105 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-70e74e8c-56a5-4c89-a9dd-c31102f97469 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:37.808672 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-70e74e8c-56a5-4c89-a9dd-c31102f97469 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:37.940758 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-70e74e8c-56a5-4c89-a9dd-c31102f97469 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:33:37.948018 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-70e74e8c-56a5-4c89-a9dd-c31102f97469 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db" status: 200 len: 1507 microversion: 2.1 time: 0.151676 Feb 15 14:33:37.949152 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 466/924] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:33:37 2022] GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:33:56.157110 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-68bf7206-8361-4dff-a7b3-6ae7d8f37165 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1af2197c-0ed5-4eb3-b00c-09b213e5bda6", "device": "/dev/sdb"}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:33:56.158717 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-68bf7206-8361-4dff-a7b3-6ae7d8f37165 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:33:56.164670 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-68bf7206-8361-4dff-a7b3-6ae7d8f37165 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:56.165127 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-68bf7206-8361-4dff-a7b3-6ae7d8f37165 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:56.165908 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-68bf7206-8361-4dff-a7b3-6ae7d8f37165 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:33:56.166351 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-68bf7206-8361-4dff-a7b3-6ae7d8f37165 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:33:56.387112 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-68bf7206-8361-4dff-a7b3-6ae7d8f37165 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "POST /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.233861 Feb 15 14:33:56.388672 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 459/925] 10.222.0.83 () {60 vars in 1322 bytes} [Tue Feb 15 14:33:56 2022] POST /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db/os-volume_attachments => generated 194 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:34:09.901301 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 14:34:09.901876 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: Tue Feb 15 14:34:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 14:34:16.239375 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-13e57eda-bc0b-4b06-9a6b-a9c83de198f4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-729337565", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-218978542", "security_groups": [{"name": "tempest-secgroup-smoke-2122136391"}], "block_device_mapping_v2": [{"uuid": "348dcbec-0886-4d84-b9ea-4aca055232d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f56af738-73d1-43bd-9e25-bf9a658bed0c"}]}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:34:16.518687 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.network.neutron [None req-13e57eda-bc0b-4b06-9a6b-a9c83de198f4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] validate_networks() for [('f56af738-73d1-43bd-9e25-bf9a658bed0c', None, None, None, None, None)] {{(pid=116363) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 14:34:16.919180 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-13e57eda-bc0b-4b06-9a6b-a9c83de198f4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Flavor limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 14:34:16.919680 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-13e57eda-bc0b-4b06-9a6b-a9c83de198f4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Image limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 14:34:16.920236 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-13e57eda-bc0b-4b06-9a6b-a9c83de198f4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Flavor pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 14:34:16.920749 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-13e57eda-bc0b-4b06-9a6b-a9c83de198f4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Image pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 14:34:16.921233 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-13e57eda-bc0b-4b06-9a6b-a9c83de198f4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 14:34:16.930212 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-13e57eda-bc0b-4b06-9a6b-a9c83de198f4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:16.930699 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-13e57eda-bc0b-4b06-9a6b-a9c83de198f4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:16.931635 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-13e57eda-bc0b-4b06-9a6b-a9c83de198f4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:16.932125 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-13e57eda-bc0b-4b06-9a6b-a9c83de198f4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:16.950003 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-13e57eda-bc0b-4b06-9a6b-a9c83de198f4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Getting quotas for project 9bc1601015ff4805a2884b047df84013. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:34:16.953972 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-13e57eda-bc0b-4b06-9a6b-a9c83de198f4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Getting quotas for user 41a62058dca64450aa608973422ff9bd and project 9bc1601015ff4805a2884b047df84013. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:34:17.009814 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-13e57eda-bc0b-4b06-9a6b-a9c83de198f4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Going to run 1 instances... {{(pid=116363) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 14:34:17.012834 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-13e57eda-bc0b-4b06-9a6b-a9c83de198f4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: c4b3e2c3-075a-4d59-b6b1-c399c86de60f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='348dcbec-0886-4d84-b9ea-4aca055232d8',volume_size=None,volume_type=None)] {{(pid=116363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 14:34:17.143035 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-13e57eda-bc0b-4b06-9a6b-a9c83de198f4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.907508 Feb 15 14:34:17.143955 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 467/926] 10.222.0.83 () {60 vars in 1146 bytes} [Tue Feb 15 14:34:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 14:34:17.155288 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-fa853328-4d90-49ca-a134-76d2dd4084b9 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:17.156621 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-fa853328-4d90-49ca-a134-76d2dd4084b9 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: c4b3e2c3-075a-4d59-b6b1-c399c86de60f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:17.446767 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-fa853328-4d90-49ca-a134-76d2dd4084b9 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:17.456182 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-fa853328-4d90-49ca-a134-76d2dd4084b9 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f" status: 200 len: 1093 microversion: 2.1 time: 0.305469 Feb 15 14:34:17.467955 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 460/927] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:17 2022] GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f => generated 1093 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:18.475296 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-e7fc1124-62b2-4f42-a3c8-4171e596a89f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:18.475899 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-e7fc1124-62b2-4f42-a3c8-4171e596a89f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: c4b3e2c3-075a-4d59-b6b1-c399c86de60f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:18.482694 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e7fc1124-62b2-4f42-a3c8-4171e596a89f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:18.483150 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e7fc1124-62b2-4f42-a3c8-4171e596a89f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:18.483927 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e7fc1124-62b2-4f42-a3c8-4171e596a89f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:18.484360 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e7fc1124-62b2-4f42-a3c8-4171e596a89f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:18.548636 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-e7fc1124-62b2-4f42-a3c8-4171e596a89f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:18.556169 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-e7fc1124-62b2-4f42-a3c8-4171e596a89f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f" status: 200 len: 1135 microversion: 2.1 time: 0.085030 Feb 15 14:34:18.556778 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 468/928] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:18 2022] GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f => generated 1135 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:19.575019 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-30d9ae43-2342-4c03-a2fa-7483a5537df4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:19.575764 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-30d9ae43-2342-4c03-a2fa-7483a5537df4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: c4b3e2c3-075a-4d59-b6b1-c399c86de60f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:19.583030 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-30d9ae43-2342-4c03-a2fa-7483a5537df4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:19.583702 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-30d9ae43-2342-4c03-a2fa-7483a5537df4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:19.584757 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-30d9ae43-2342-4c03-a2fa-7483a5537df4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:19.585369 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-30d9ae43-2342-4c03-a2fa-7483a5537df4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:19.839355 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-30d9ae43-2342-4c03-a2fa-7483a5537df4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:19.847533 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-30d9ae43-2342-4c03-a2fa-7483a5537df4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f" status: 200 len: 1277 microversion: 2.1 time: 0.277012 Feb 15 14:34:19.848103 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 461/929] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:19 2022] GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f => generated 1277 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:20.425417 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-ed7a87a9-e226-45c6-8180-e1e984c5568c req-0e609c66-fd2e-4606-af9b-64730282cb1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b3e2c3-075a-4d59-b6b1-c399c86de60f", "tag": "b1fceff6-3d3d-4ab3-a0dc-f4e8cfeb62a8"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:34:20.427241 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:34:20.427241 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:34:20.442320 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-ed7a87a9-e226-45c6-8180-e1e984c5568c req-0e609c66-fd2e-4606-af9b-64730282cb1c service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:20.443523 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-ed7a87a9-e226-45c6-8180-e1e984c5568c req-0e609c66-fd2e-4606-af9b-64730282cb1c service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:20.459814 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-ed7a87a9-e226-45c6-8180-e1e984c5568c req-0e609c66-fd2e-4606-af9b-64730282cb1c service nova] Creating event network-changed:b1fceff6-3d3d-4ab3-a0dc-f4e8cfeb62a8 for instance c4b3e2c3-075a-4d59-b6b1-c399c86de60f on hv-cinder-81914 Feb 15 14:34:20.467472 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-ed7a87a9-e226-45c6-8180-e1e984c5568c req-0e609c66-fd2e-4606-af9b-64730282cb1c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045508 Feb 15 14:34:20.468279 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 469/930] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:34:20.864863 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-5d1035d1-981d-4e6d-b963-6a8605d27e70 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:20.865474 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-5d1035d1-981d-4e6d-b963-6a8605d27e70 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: c4b3e2c3-075a-4d59-b6b1-c399c86de60f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:20.875053 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5d1035d1-981d-4e6d-b963-6a8605d27e70 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:20.875772 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5d1035d1-981d-4e6d-b963-6a8605d27e70 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:20.876786 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5d1035d1-981d-4e6d-b963-6a8605d27e70 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:20.877383 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5d1035d1-981d-4e6d-b963-6a8605d27e70 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:21.068870 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-5d1035d1-981d-4e6d-b963-6a8605d27e70 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:21.077196 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-5d1035d1-981d-4e6d-b963-6a8605d27e70 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f" status: 200 len: 1265 microversion: 2.1 time: 0.216426 Feb 15 14:34:21.077767 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 462/931] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:20 2022] GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:22.100730 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-909a6644-e564-415a-9360-903a3e72f172 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:22.101604 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-909a6644-e564-415a-9360-903a3e72f172 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: c4b3e2c3-075a-4d59-b6b1-c399c86de60f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:22.108922 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-909a6644-e564-415a-9360-903a3e72f172 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:22.109871 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-909a6644-e564-415a-9360-903a3e72f172 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:22.110830 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-909a6644-e564-415a-9360-903a3e72f172 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:22.111453 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-909a6644-e564-415a-9360-903a3e72f172 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:22.280776 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-909a6644-e564-415a-9360-903a3e72f172 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:22.292393 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-909a6644-e564-415a-9360-903a3e72f172 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f" status: 200 len: 1265 microversion: 2.1 time: 0.195819 Feb 15 14:34:22.293550 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 470/932] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:22 2022] GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:23.046608 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-1ac1bceb-07a6-4812-8388-b22b1adacdc2 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:23.047116 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-1ac1bceb-07a6-4812-8388-b22b1adacdc2 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:23.053328 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1ac1bceb-07a6-4812-8388-b22b1adacdc2 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:23.053777 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1ac1bceb-07a6-4812-8388-b22b1adacdc2 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:23.054613 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1ac1bceb-07a6-4812-8388-b22b1adacdc2 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:23.055045 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1ac1bceb-07a6-4812-8388-b22b1adacdc2 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:23.131873 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.objects.instance [None req-1ac1bceb-07a6-4812-8388-b22b1adacdc2 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lazy-loading 'services' on Instance uuid 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db {{(pid=116362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:34:23.199948 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-1ac1bceb-07a6-4812-8388-b22b1adacdc2 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "DELETE /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db/os-volume_attachments/1af2197c-0ed5-4eb3-b00c-09b213e5bda6" status: 202 len: 0 microversion: 2.1 time: 0.157153 Feb 15 14:34:23.200581 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 463/933] 10.222.0.83 () {58 vars in 1415 bytes} [Tue Feb 15 14:34:23 2022] DELETE /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db/os-volume_attachments/1af2197c-0ed5-4eb3-b00c-09b213e5bda6 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:34:23.312064 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-852ffd6c-ba6d-44f9-86de-cf2fc57aca42 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:23.312717 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-852ffd6c-ba6d-44f9-86de-cf2fc57aca42 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: c4b3e2c3-075a-4d59-b6b1-c399c86de60f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:23.319299 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-852ffd6c-ba6d-44f9-86de-cf2fc57aca42 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:23.319754 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-852ffd6c-ba6d-44f9-86de-cf2fc57aca42 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:23.320569 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-852ffd6c-ba6d-44f9-86de-cf2fc57aca42 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:23.321013 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-852ffd6c-ba6d-44f9-86de-cf2fc57aca42 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:23.463441 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-852ffd6c-ba6d-44f9-86de-cf2fc57aca42 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:23.471495 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-852ffd6c-ba6d-44f9-86de-cf2fc57aca42 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f" status: 200 len: 1265 microversion: 2.1 time: 0.165342 Feb 15 14:34:23.472071 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 471/934] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:23 2022] GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:24.308242 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-4aa84628-c36b-4362-8405-0343e4157833 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:24.309716 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-4aa84628-c36b-4362-8405-0343e4157833 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:24.315818 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4aa84628-c36b-4362-8405-0343e4157833 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:24.316269 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4aa84628-c36b-4362-8405-0343e4157833 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:24.317092 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4aa84628-c36b-4362-8405-0343e4157833 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:24.317530 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4aa84628-c36b-4362-8405-0343e4157833 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:24.341653 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-4aa84628-c36b-4362-8405-0343e4157833 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db] Going to try to terminate instance {{(pid=116362) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 14:34:24.413498 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-4aa84628-c36b-4362-8405-0343e4157833 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "DELETE /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db" status: 204 len: 0 microversion: 2.1 time: 0.109426 Feb 15 14:34:24.414077 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 464/935] 10.222.0.83 () {58 vars in 1238 bytes} [Tue Feb 15 14:34:24 2022] DELETE /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 14:34:24.424100 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-320362ce-ed8a-44b6-9031-e83262dd804b tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:24.424842 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-320362ce-ed8a-44b6-9031-e83262dd804b tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:24.431207 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-320362ce-ed8a-44b6-9031-e83262dd804b tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:24.431653 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-320362ce-ed8a-44b6-9031-e83262dd804b tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:24.432448 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-320362ce-ed8a-44b6-9031-e83262dd804b tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:24.432895 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-320362ce-ed8a-44b6-9031-e83262dd804b tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:24.489873 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-c536cd6c-a524-45bc-bf84-8b94703fd115 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:24.490615 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-c536cd6c-a524-45bc-bf84-8b94703fd115 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: c4b3e2c3-075a-4d59-b6b1-c399c86de60f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:24.497371 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c536cd6c-a524-45bc-bf84-8b94703fd115 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:24.497825 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c536cd6c-a524-45bc-bf84-8b94703fd115 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:24.498822 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c536cd6c-a524-45bc-bf84-8b94703fd115 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:24.499500 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c536cd6c-a524-45bc-bf84-8b94703fd115 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:24.571680 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-320362ce-ed8a-44b6-9031-e83262dd804b tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:24.579814 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-320362ce-ed8a-44b6-9031-e83262dd804b tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db" status: 200 len: 1513 microversion: 2.1 time: 0.160671 Feb 15 14:34:24.580421 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 472/936] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:24 2022] GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:24.644156 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-c536cd6c-a524-45bc-bf84-8b94703fd115 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:24.651455 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-c536cd6c-a524-45bc-bf84-8b94703fd115 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f" status: 200 len: 1265 microversion: 2.1 time: 0.165706 Feb 15 14:34:24.652050 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 465/937] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:24 2022] GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:34:25.596806 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-fb1fc003-6a02-4f71-9ea2-65d517583780 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:25.597449 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-fb1fc003-6a02-4f71-9ea2-65d517583780 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:25.603719 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-fb1fc003-6a02-4f71-9ea2-65d517583780 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:25.604071 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-fb1fc003-6a02-4f71-9ea2-65d517583780 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:25.604879 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-fb1fc003-6a02-4f71-9ea2-65d517583780 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:25.605992 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-fb1fc003-6a02-4f71-9ea2-65d517583780 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:25.669427 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-ea256647-3d25-464c-adb9-fdfc72e0e0b0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:25.670068 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-ea256647-3d25-464c-adb9-fdfc72e0e0b0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: c4b3e2c3-075a-4d59-b6b1-c399c86de60f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:25.676301 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ea256647-3d25-464c-adb9-fdfc72e0e0b0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:25.676777 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ea256647-3d25-464c-adb9-fdfc72e0e0b0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:25.677560 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ea256647-3d25-464c-adb9-fdfc72e0e0b0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:25.677999 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-ea256647-3d25-464c-adb9-fdfc72e0e0b0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:25.806793 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-fb1fc003-6a02-4f71-9ea2-65d517583780 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:25.814532 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-fb1fc003-6a02-4f71-9ea2-65d517583780 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db" status: 200 len: 1513 microversion: 2.1 time: 0.221462 Feb 15 14:34:25.815114 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 473/938] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:25 2022] GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db => generated 1513 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:25.853466 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-ea256647-3d25-464c-adb9-fdfc72e0e0b0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:25.861023 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-ea256647-3d25-464c-adb9-fdfc72e0e0b0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f" status: 200 len: 1265 microversion: 2.1 time: 0.196309 Feb 15 14:34:25.861601 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 466/939] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:25 2022] GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:34:26.831209 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-0ab537f1-7d88-4d63-b14f-8ce3c917d45c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:26.831826 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-0ab537f1-7d88-4d63-b14f-8ce3c917d45c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:26.838708 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0ab537f1-7d88-4d63-b14f-8ce3c917d45c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:26.839237 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0ab537f1-7d88-4d63-b14f-8ce3c917d45c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:26.840283 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0ab537f1-7d88-4d63-b14f-8ce3c917d45c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:26.840749 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0ab537f1-7d88-4d63-b14f-8ce3c917d45c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:26.877829 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-663685a7-2cfb-41b2-a310-d644e5c880a6 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:26.879145 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-663685a7-2cfb-41b2-a310-d644e5c880a6 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: c4b3e2c3-075a-4d59-b6b1-c399c86de60f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:26.886298 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-663685a7-2cfb-41b2-a310-d644e5c880a6 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:26.887465 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-663685a7-2cfb-41b2-a310-d644e5c880a6 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:26.888730 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-663685a7-2cfb-41b2-a310-d644e5c880a6 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:26.890052 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-663685a7-2cfb-41b2-a310-d644e5c880a6 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:26.922786 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-0ab537f1-7d88-4d63-b14f-8ce3c917d45c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:26.930381 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-0ab537f1-7d88-4d63-b14f-8ce3c917d45c tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db" status: 200 len: 1471 microversion: 2.1 time: 0.103055 Feb 15 14:34:26.930967 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 474/940] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:26 2022] GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db => generated 1471 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:27.032500 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-d9ba1f15-3035-40a0-bfd9-53a7e5f49527 req-33c8453b-1591-492d-a03e-169a3eb72cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db", "name": "network-vif-deleted", "tag": "e811d6de-5b3e-4a58-9f1f-d3c491a3bac1"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:34:27.035230 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:34:27.035230 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:34:27.050577 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-d9ba1f15-3035-40a0-bfd9-53a7e5f49527 req-33c8453b-1591-492d-a03e-169a3eb72cd3 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:27.051869 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-d9ba1f15-3035-40a0-bfd9-53a7e5f49527 req-33c8453b-1591-492d-a03e-169a3eb72cd3 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:27.081340 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-d9ba1f15-3035-40a0-bfd9-53a7e5f49527 req-33c8453b-1591-492d-a03e-169a3eb72cd3 service nova] Creating event network-vif-deleted:e811d6de-5b3e-4a58-9f1f-d3c491a3bac1 for instance 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db on hv-cinder-81914 Feb 15 14:34:27.087032 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-d9ba1f15-3035-40a0-bfd9-53a7e5f49527 req-33c8453b-1591-492d-a03e-169a3eb72cd3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064461 Feb 15 14:34:27.088343 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 475/941] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:34:27.131431 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-663685a7-2cfb-41b2-a310-d644e5c880a6 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:27.139254 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-663685a7-2cfb-41b2-a310-d644e5c880a6 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f" status: 200 len: 1265 microversion: 2.1 time: 0.265008 Feb 15 14:34:27.140643 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 467/942] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:26 2022] GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:27.948288 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-49f8a169-d4ff-4084-b6ed-50d2d96ddb26 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:27.949023 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-49f8a169-d4ff-4084-b6ed-50d2d96ddb26 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:27.955799 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-49f8a169-d4ff-4084-b6ed-50d2d96ddb26 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:27.956250 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-49f8a169-d4ff-4084-b6ed-50d2d96ddb26 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:27.957100 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-49f8a169-d4ff-4084-b6ed-50d2d96ddb26 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:27.957542 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-49f8a169-d4ff-4084-b6ed-50d2d96ddb26 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:27.971445 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.wsgi [None req-49f8a169-d4ff-4084-b6ed-50d2d96ddb26 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] HTTP exception thrown: Instance 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db could not be found. Feb 15 14:34:27.972037 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-49f8a169-d4ff-4084-b6ed-50d2d96ddb26 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Returning 404 to user: Instance 0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db could not be found. {{(pid=116363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:34:27.972909 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-49f8a169-d4ff-4084-b6ed-50d2d96ddb26 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db" status: 404 len: 111 microversion: 2.1 time: 0.029312 Feb 15 14:34:27.973455 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 476/943] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:27 2022] GET /compute/v2.1/servers/0cea78fd-ddbc-4fd0-b88b-6088b7d9a5db => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:34:28.156268 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-80bb65e6-be9c-455f-8b4e-a9f3c059519b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:28.156959 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-80bb65e6-be9c-455f-8b4e-a9f3c059519b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: c4b3e2c3-075a-4d59-b6b1-c399c86de60f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:28.163140 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-80bb65e6-be9c-455f-8b4e-a9f3c059519b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:28.163594 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-80bb65e6-be9c-455f-8b4e-a9f3c059519b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:28.164650 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-80bb65e6-be9c-455f-8b4e-a9f3c059519b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:28.165096 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-80bb65e6-be9c-455f-8b4e-a9f3c059519b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:28.304010 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-80bb65e6-be9c-455f-8b4e-a9f3c059519b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:28.312321 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-80bb65e6-be9c-455f-8b4e-a9f3c059519b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f" status: 200 len: 1265 microversion: 2.1 time: 0.160284 Feb 15 14:34:28.312919 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 468/944] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:28 2022] GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:28.843380 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-61999ab5-fe84-401a-8c42-689cd694e594 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1791447452", "imageRef": "da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53", "flavorRef": "452"}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:34:28.893092 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.network.neutron [None req-61999ab5-fe84-401a-8c42-689cd694e594 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] validate_networks() for None {{(pid=116363) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 14:34:29.156995 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-61999ab5-fe84-401a-8c42-689cd694e594 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Flavor limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 14:34:29.157568 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-61999ab5-fe84-401a-8c42-689cd694e594 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Image limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 14:34:29.158242 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-61999ab5-fe84-401a-8c42-689cd694e594 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Flavor pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 14:34:29.158653 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-61999ab5-fe84-401a-8c42-689cd694e594 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Image pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 14:34:29.159411 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-61999ab5-fe84-401a-8c42-689cd694e594 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 14:34:29.170417 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-61999ab5-fe84-401a-8c42-689cd694e594 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:29.171070 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-61999ab5-fe84-401a-8c42-689cd694e594 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:29.171893 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-61999ab5-fe84-401a-8c42-689cd694e594 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:29.172372 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-61999ab5-fe84-401a-8c42-689cd694e594 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:29.189049 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-61999ab5-fe84-401a-8c42-689cd694e594 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Getting quotas for project 709cad92425942acb6a714ee8a5bcfa3. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:34:29.193041 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-61999ab5-fe84-401a-8c42-689cd694e594 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Getting quotas for user 987d5800f5af4c6e8cd3811285b36706 and project 709cad92425942acb6a714ee8a5bcfa3. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:34:29.204109 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-61999ab5-fe84-401a-8c42-689cd694e594 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Going to run 1 instances... {{(pid=116363) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 14:34:29.206467 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-61999ab5-fe84-401a-8c42-689cd694e594 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] [instance: 3f7d167b-b2db-4317-9236-c1de2124c54a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 14:34:29.249986 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-61999ab5-fe84-401a-8c42-689cd694e594 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.410307 Feb 15 14:34:29.250627 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 477/945] 10.222.0.83 () {60 vars in 1146 bytes} [Tue Feb 15 14:34:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 14:34:29.260302 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-4ff2bd02-236d-4a94-82c5-da7f7608c827 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:29.260986 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-4ff2bd02-236d-4a94-82c5-da7f7608c827 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] [instance: 3f7d167b-b2db-4317-9236-c1de2124c54a] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:29.315206 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-4ff2bd02-236d-4a94-82c5-da7f7608c827 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d5800f5af4c6e8cd3811285b36706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cad92425942acb6a714ee8a5bcfa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:29.328213 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-4ff2bd02-236d-4a94-82c5-da7f7608c827 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] 10.222.0.83 "GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a" status: 200 len: 1215 microversion: 2.1 time: 0.071480 Feb 15 14:34:29.328639 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-616780d2-e281-4f45-985c-c085840ca150 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:29.329418 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-616780d2-e281-4f45-985c-c085840ca150 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: c4b3e2c3-075a-4d59-b6b1-c399c86de60f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:29.329810 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 469/946] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:29 2022] GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:29.336437 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-616780d2-e281-4f45-985c-c085840ca150 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:29.336888 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-616780d2-e281-4f45-985c-c085840ca150 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:29.337663 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-616780d2-e281-4f45-985c-c085840ca150 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:29.338089 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-616780d2-e281-4f45-985c-c085840ca150 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:29.474610 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-616780d2-e281-4f45-985c-c085840ca150 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:29.482944 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-616780d2-e281-4f45-985c-c085840ca150 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f" status: 200 len: 1265 microversion: 2.1 time: 0.157979 Feb 15 14:34:29.483485 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 478/947] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:29 2022] GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:30.345157 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-1cd03c0f-4cae-47f3-93ce-3bbbec447cdb tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:30.345806 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-1cd03c0f-4cae-47f3-93ce-3bbbec447cdb tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] [instance: 3f7d167b-b2db-4317-9236-c1de2124c54a] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:30.354565 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1cd03c0f-4cae-47f3-93ce-3bbbec447cdb tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:30.355025 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1cd03c0f-4cae-47f3-93ce-3bbbec447cdb tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:30.356611 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1cd03c0f-4cae-47f3-93ce-3bbbec447cdb tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:30.357089 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1cd03c0f-4cae-47f3-93ce-3bbbec447cdb tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:30.415574 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-1cd03c0f-4cae-47f3-93ce-3bbbec447cdb tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d5800f5af4c6e8cd3811285b36706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cad92425942acb6a714ee8a5bcfa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:30.423314 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-1cd03c0f-4cae-47f3-93ce-3bbbec447cdb tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] 10.222.0.83 "GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a" status: 200 len: 1219 microversion: 2.1 time: 0.081853 Feb 15 14:34:30.423879 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 470/948] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:30 2022] GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:30.500157 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-80438e63-c3af-4cdb-9376-0b753416e606 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:30.500810 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-80438e63-c3af-4cdb-9376-0b753416e606 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: c4b3e2c3-075a-4d59-b6b1-c399c86de60f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:30.507216 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-80438e63-c3af-4cdb-9376-0b753416e606 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:30.507689 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-80438e63-c3af-4cdb-9376-0b753416e606 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:30.508478 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-80438e63-c3af-4cdb-9376-0b753416e606 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:30.508921 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-80438e63-c3af-4cdb-9376-0b753416e606 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:30.643101 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-80438e63-c3af-4cdb-9376-0b753416e606 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:30.650449 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-80438e63-c3af-4cdb-9376-0b753416e606 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f" status: 200 len: 1265 microversion: 2.1 time: 0.154879 Feb 15 14:34:30.651027 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 479/949] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:30 2022] GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:31.439943 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-a7077210-41e2-4761-bf17-9a8733d5d701 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:31.440568 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-a7077210-41e2-4761-bf17-9a8733d5d701 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] [instance: 3f7d167b-b2db-4317-9236-c1de2124c54a] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:31.446798 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a7077210-41e2-4761-bf17-9a8733d5d701 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:31.447247 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a7077210-41e2-4761-bf17-9a8733d5d701 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:31.448017 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a7077210-41e2-4761-bf17-9a8733d5d701 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:31.448472 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-a7077210-41e2-4761-bf17-9a8733d5d701 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:31.515976 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-a7077210-41e2-4761-bf17-9a8733d5d701 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d5800f5af4c6e8cd3811285b36706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cad92425942acb6a714ee8a5bcfa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:31.523929 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-a7077210-41e2-4761-bf17-9a8733d5d701 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] 10.222.0.83 "GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a" status: 200 len: 1267 microversion: 2.1 time: 0.087677 Feb 15 14:34:31.524970 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 471/950] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:31 2022] GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:31.671704 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-62d50da7-1487-41ee-9cad-8ec47dd0f28b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:31.673014 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-62d50da7-1487-41ee-9cad-8ec47dd0f28b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: c4b3e2c3-075a-4d59-b6b1-c399c86de60f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:31.681885 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-62d50da7-1487-41ee-9cad-8ec47dd0f28b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:31.682580 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-62d50da7-1487-41ee-9cad-8ec47dd0f28b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:31.683919 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-62d50da7-1487-41ee-9cad-8ec47dd0f28b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:31.684357 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-62d50da7-1487-41ee-9cad-8ec47dd0f28b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:31.914130 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-62d50da7-1487-41ee-9cad-8ec47dd0f28b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:31.921540 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-62d50da7-1487-41ee-9cad-8ec47dd0f28b tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f" status: 200 len: 1265 microversion: 2.1 time: 0.256944 Feb 15 14:34:31.922263 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 480/951] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:31 2022] GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:32.227105 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-063c0d80-60fc-470f-837e-f1fc90913407 req-1f68144c-2837-4ecb-9b60-ccd9db6e4456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b3e2c3-075a-4d59-b6b1-c399c86de60f", "name": "network-vif-plugged", "status": "completed", "tag": "b1fceff6-3d3d-4ab3-a0dc-f4e8cfeb62a8"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:34:32.229189 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:34:32.229189 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:34:32.237665 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-063c0d80-60fc-470f-837e-f1fc90913407 req-1f68144c-2837-4ecb-9b60-ccd9db6e4456 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:32.238149 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-063c0d80-60fc-470f-837e-f1fc90913407 req-1f68144c-2837-4ecb-9b60-ccd9db6e4456 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:32.249971 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-063c0d80-60fc-470f-837e-f1fc90913407 req-1f68144c-2837-4ecb-9b60-ccd9db6e4456 service nova] Creating event network-vif-plugged:b1fceff6-3d3d-4ab3-a0dc-f4e8cfeb62a8 for instance c4b3e2c3-075a-4d59-b6b1-c399c86de60f on hv-cinder-81914 Feb 15 14:34:32.255726 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-063c0d80-60fc-470f-837e-f1fc90913407 req-1f68144c-2837-4ecb-9b60-ccd9db6e4456 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033170 Feb 15 14:34:32.257001 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 472/952] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:34:32.540795 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-c8d0f815-8c67-46e0-a86f-f1f299d956c5 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:32.541416 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-c8d0f815-8c67-46e0-a86f-f1f299d956c5 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] [instance: 3f7d167b-b2db-4317-9236-c1de2124c54a] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:32.548246 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c8d0f815-8c67-46e0-a86f-f1f299d956c5 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:32.549976 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c8d0f815-8c67-46e0-a86f-f1f299d956c5 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:32.551361 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c8d0f815-8c67-46e0-a86f-f1f299d956c5 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:32.559728 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c8d0f815-8c67-46e0-a86f-f1f299d956c5 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:32.849823 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-c8d0f815-8c67-46e0-a86f-f1f299d956c5 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d5800f5af4c6e8cd3811285b36706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cad92425942acb6a714ee8a5bcfa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:32.857100 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-c8d0f815-8c67-46e0-a86f-f1f299d956c5 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] 10.222.0.83 "GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a" status: 200 len: 1315 microversion: 2.1 time: 0.320009 Feb 15 14:34:32.857821 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 481/953] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:32 2022] GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:32.940168 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-1ff88316-3b56-4bdf-8c1d-0df0e8d2a597 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:32.940906 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-1ff88316-3b56-4bdf-8c1d-0df0e8d2a597 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: c4b3e2c3-075a-4d59-b6b1-c399c86de60f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:32.946819 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1ff88316-3b56-4bdf-8c1d-0df0e8d2a597 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:32.947267 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1ff88316-3b56-4bdf-8c1d-0df0e8d2a597 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:32.948046 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1ff88316-3b56-4bdf-8c1d-0df0e8d2a597 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:32.948584 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1ff88316-3b56-4bdf-8c1d-0df0e8d2a597 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:33.095436 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-1ff88316-3b56-4bdf-8c1d-0df0e8d2a597 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:33.103781 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-1ff88316-3b56-4bdf-8c1d-0df0e8d2a597 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f" status: 200 len: 1265 microversion: 2.1 time: 0.168227 Feb 15 14:34:33.104364 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 473/954] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:32 2022] GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:34:33.481394 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-0d131668-2d9a-4c17-89f7-7120d625d37a req-02c5b2a2-5756-48bb-ac67-118ec06ed2e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f7d167b-b2db-4317-9236-c1de2124c54a", "tag": "ab426fe5-2e8a-469d-ae87-15470ec35613"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:34:33.484235 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:34:33.484235 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:34:33.504997 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-0d131668-2d9a-4c17-89f7-7120d625d37a req-02c5b2a2-5756-48bb-ac67-118ec06ed2e3 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:33.509410 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-0d131668-2d9a-4c17-89f7-7120d625d37a req-02c5b2a2-5756-48bb-ac67-118ec06ed2e3 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:33.527126 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-0d131668-2d9a-4c17-89f7-7120d625d37a req-02c5b2a2-5756-48bb-ac67-118ec06ed2e3 service nova] Creating event network-changed:ab426fe5-2e8a-469d-ae87-15470ec35613 for instance 3f7d167b-b2db-4317-9236-c1de2124c54a on hv-cinder-81914 Feb 15 14:34:33.550055 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-0d131668-2d9a-4c17-89f7-7120d625d37a req-02c5b2a2-5756-48bb-ac67-118ec06ed2e3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072349 Feb 15 14:34:33.550996 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 482/955] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:34:33.876046 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-f024330c-2d24-470d-9bf9-2b1badfcb6b1 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:33.876951 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-f024330c-2d24-470d-9bf9-2b1badfcb6b1 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] [instance: 3f7d167b-b2db-4317-9236-c1de2124c54a] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:33.883200 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f024330c-2d24-470d-9bf9-2b1badfcb6b1 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:33.883661 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f024330c-2d24-470d-9bf9-2b1badfcb6b1 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:33.884493 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f024330c-2d24-470d-9bf9-2b1badfcb6b1 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:33.884933 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f024330c-2d24-470d-9bf9-2b1badfcb6b1 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:34.029741 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-f024330c-2d24-470d-9bf9-2b1badfcb6b1 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d5800f5af4c6e8cd3811285b36706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cad92425942acb6a714ee8a5bcfa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:34.037052 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-f024330c-2d24-470d-9bf9-2b1badfcb6b1 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] 10.222.0.83 "GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a" status: 200 len: 1315 microversion: 2.1 time: 0.164776 Feb 15 14:34:34.037623 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 474/956] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:33 2022] GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:34.122047 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-6fe83558-8010-4e8f-b1c1-cefcad6a3811 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:34.122789 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-6fe83558-8010-4e8f-b1c1-cefcad6a3811 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: c4b3e2c3-075a-4d59-b6b1-c399c86de60f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:34.129128 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6fe83558-8010-4e8f-b1c1-cefcad6a3811 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:34.129583 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6fe83558-8010-4e8f-b1c1-cefcad6a3811 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:34.130357 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6fe83558-8010-4e8f-b1c1-cefcad6a3811 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:34.130803 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6fe83558-8010-4e8f-b1c1-cefcad6a3811 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:34.280695 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-6fe83558-8010-4e8f-b1c1-cefcad6a3811 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:34.287993 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-6fe83558-8010-4e8f-b1c1-cefcad6a3811 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f" status: 200 len: 1452 microversion: 2.1 time: 0.171098 Feb 15 14:34:34.288580 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 483/957] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:34 2022] GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:34.304178 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-3d849472-afc9-498e-b375-8d701350d6a0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:34.304829 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-3d849472-afc9-498e-b375-8d701350d6a0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: c4b3e2c3-075a-4d59-b6b1-c399c86de60f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:34.310785 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3d849472-afc9-498e-b375-8d701350d6a0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:34.311234 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3d849472-afc9-498e-b375-8d701350d6a0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:34.312008 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3d849472-afc9-498e-b375-8d701350d6a0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:34.312474 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3d849472-afc9-498e-b375-8d701350d6a0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:34.444638 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-3d849472-afc9-498e-b375-8d701350d6a0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:34.452635 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-3d849472-afc9-498e-b375-8d701350d6a0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f" status: 200 len: 1452 microversion: 2.1 time: 0.152086 Feb 15 14:34:34.453234 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 475/958] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:34 2022] GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:35.053650 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-c0cca7ea-b3a8-41f7-946c-875513096548 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:35.054263 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-c0cca7ea-b3a8-41f7-946c-875513096548 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] [instance: 3f7d167b-b2db-4317-9236-c1de2124c54a] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:35.060996 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c0cca7ea-b3a8-41f7-946c-875513096548 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:35.061455 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c0cca7ea-b3a8-41f7-946c-875513096548 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:35.062237 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c0cca7ea-b3a8-41f7-946c-875513096548 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:35.062673 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c0cca7ea-b3a8-41f7-946c-875513096548 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:35.199985 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-c0cca7ea-b3a8-41f7-946c-875513096548 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d5800f5af4c6e8cd3811285b36706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cad92425942acb6a714ee8a5bcfa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:35.207475 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-c0cca7ea-b3a8-41f7-946c-875513096548 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] 10.222.0.83 "GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a" status: 200 len: 1315 microversion: 2.1 time: 0.157476 Feb 15 14:34:35.208051 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 484/959] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:35 2022] GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:36.048811 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-fc8d956d-cc40-41c7-9300-915bb17760ec req-5ab2ae67-7c24-40c4-b6f6-726622345fdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b3e2c3-075a-4d59-b6b1-c399c86de60f", "tag": "b1fceff6-3d3d-4ab3-a0dc-f4e8cfeb62a8"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:34:36.050670 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:34:36.050670 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:34:36.058406 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-fc8d956d-cc40-41c7-9300-915bb17760ec req-5ab2ae67-7c24-40c4-b6f6-726622345fdf service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:36.058933 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-fc8d956d-cc40-41c7-9300-915bb17760ec req-5ab2ae67-7c24-40c4-b6f6-726622345fdf service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:36.070086 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-fc8d956d-cc40-41c7-9300-915bb17760ec req-5ab2ae67-7c24-40c4-b6f6-726622345fdf service nova] Creating event network-changed:b1fceff6-3d3d-4ab3-a0dc-f4e8cfeb62a8 for instance c4b3e2c3-075a-4d59-b6b1-c399c86de60f on hv-cinder-81914 Feb 15 14:34:36.075453 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-fc8d956d-cc40-41c7-9300-915bb17760ec req-5ab2ae67-7c24-40c4-b6f6-726622345fdf service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030332 Feb 15 14:34:36.076053 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 476/960] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:34:36.225396 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-90fc0c43-24bb-479d-9d52-cf13b19744da tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:36.226016 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-90fc0c43-24bb-479d-9d52-cf13b19744da tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] [instance: 3f7d167b-b2db-4317-9236-c1de2124c54a] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:36.232848 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-90fc0c43-24bb-479d-9d52-cf13b19744da tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:36.233298 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-90fc0c43-24bb-479d-9d52-cf13b19744da tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:36.234077 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-90fc0c43-24bb-479d-9d52-cf13b19744da tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:36.234519 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-90fc0c43-24bb-479d-9d52-cf13b19744da tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:36.366517 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-90fc0c43-24bb-479d-9d52-cf13b19744da tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d5800f5af4c6e8cd3811285b36706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cad92425942acb6a714ee8a5bcfa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:36.374039 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-90fc0c43-24bb-479d-9d52-cf13b19744da tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] 10.222.0.83 "GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a" status: 200 len: 1315 microversion: 2.1 time: 0.152346 Feb 15 14:34:36.374614 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 485/961] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:36 2022] GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:37.392055 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-65dca9c8-f114-4614-88a5-af8bd2554d3b tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:37.392830 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-65dca9c8-f114-4614-88a5-af8bd2554d3b tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] [instance: 3f7d167b-b2db-4317-9236-c1de2124c54a] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:37.398953 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-65dca9c8-f114-4614-88a5-af8bd2554d3b tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:37.399404 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-65dca9c8-f114-4614-88a5-af8bd2554d3b tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:37.400173 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-65dca9c8-f114-4614-88a5-af8bd2554d3b tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:37.400641 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-65dca9c8-f114-4614-88a5-af8bd2554d3b tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:37.776242 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-65dca9c8-f114-4614-88a5-af8bd2554d3b tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d5800f5af4c6e8cd3811285b36706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cad92425942acb6a714ee8a5bcfa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:37.783876 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-65dca9c8-f114-4614-88a5-af8bd2554d3b tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] 10.222.0.83 "GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a" status: 200 len: 1315 microversion: 2.1 time: 0.396527 Feb 15 14:34:37.784457 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 477/962] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:37 2022] GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:37.886299 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-3c1b5aba-34f3-4174-bc88-ff4dee3f98d4 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1645602930", "imageRef": "da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53", "flavorRef": "452", "networks": [{"uuid": "50b1d3df-2a0e-4293-b2d4-b2ff45bdeb2a"}]}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:34:37.936122 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.network.neutron [None req-3c1b5aba-34f3-4174-bc88-ff4dee3f98d4 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] validate_networks() for [('50b1d3df-2a0e-4293-b2d4-b2ff45bdeb2a', None, None, None, None, None)] {{(pid=116363) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 14:34:38.317643 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-3c1b5aba-34f3-4174-bc88-ff4dee3f98d4 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Flavor limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 14:34:38.318067 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-3c1b5aba-34f3-4174-bc88-ff4dee3f98d4 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Image limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 14:34:38.318538 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-3c1b5aba-34f3-4174-bc88-ff4dee3f98d4 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Flavor pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 14:34:38.318946 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-3c1b5aba-34f3-4174-bc88-ff4dee3f98d4 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Image pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 14:34:38.319354 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-3c1b5aba-34f3-4174-bc88-ff4dee3f98d4 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 14:34:38.327951 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3c1b5aba-34f3-4174-bc88-ff4dee3f98d4 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:38.328395 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3c1b5aba-34f3-4174-bc88-ff4dee3f98d4 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:38.329231 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3c1b5aba-34f3-4174-bc88-ff4dee3f98d4 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:38.329661 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3c1b5aba-34f3-4174-bc88-ff4dee3f98d4 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:38.346214 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-3c1b5aba-34f3-4174-bc88-ff4dee3f98d4 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Getting quotas for project 8b9494e5cf9042de869b6a3d9505d51e. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:34:38.350098 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-3c1b5aba-34f3-4174-bc88-ff4dee3f98d4 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Getting quotas for user b91a680236734dddb8c5fd1dfaebd60b and project 8b9494e5cf9042de869b6a3d9505d51e. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:34:38.361450 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-3c1b5aba-34f3-4174-bc88-ff4dee3f98d4 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Going to run 1 instances... {{(pid=116363) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 14:34:38.363762 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-3c1b5aba-34f3-4174-bc88-ff4dee3f98d4 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 9300405c-2782-49b6-af3f-42c6e8b98e4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da9dbbc3-1b0b-4a9b-9d0d-ac82af387f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 14:34:38.410321 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-3c1b5aba-34f3-4174-bc88-ff4dee3f98d4 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527757 Feb 15 14:34:38.411010 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 486/963] 10.222.0.83 () {60 vars in 1146 bytes} [Tue Feb 15 14:34:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 14:34:38.421297 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-f994d535-32a4-464c-9d72-5252493a77c6 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:38.421917 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-f994d535-32a4-464c-9d72-5252493a77c6 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 9300405c-2782-49b6-af3f-42c6e8b98e4c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:38.472547 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-f994d535-32a4-464c-9d72-5252493a77c6 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:38.479156 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-f994d535-32a4-464c-9d72-5252493a77c6 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c" status: 200 len: 1219 microversion: 2.1 time: 0.062173 Feb 15 14:34:38.479822 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 478/964] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:38 2022] GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c => generated 1219 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:38.801044 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-1282bcbd-807c-4e73-b656-e03ccafb791f tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:38.801854 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-1282bcbd-807c-4e73-b656-e03ccafb791f tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] [instance: 3f7d167b-b2db-4317-9236-c1de2124c54a] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:38.808047 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1282bcbd-807c-4e73-b656-e03ccafb791f tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:38.808572 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1282bcbd-807c-4e73-b656-e03ccafb791f tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:38.809450 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1282bcbd-807c-4e73-b656-e03ccafb791f tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:38.809897 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1282bcbd-807c-4e73-b656-e03ccafb791f tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:38.962457 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-1282bcbd-807c-4e73-b656-e03ccafb791f tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d5800f5af4c6e8cd3811285b36706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cad92425942acb6a714ee8a5bcfa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:38.970084 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-1282bcbd-807c-4e73-b656-e03ccafb791f tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] 10.222.0.83 "GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a" status: 200 len: 1315 microversion: 2.1 time: 0.172750 Feb 15 14:34:38.970657 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 487/965] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:38 2022] GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:39.497539 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-f07778e4-3836-471a-b393-f172af9384fe tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:39.498902 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-f07778e4-3836-471a-b393-f172af9384fe tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 9300405c-2782-49b6-af3f-42c6e8b98e4c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:39.507243 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f07778e4-3836-471a-b393-f172af9384fe tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:39.508023 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f07778e4-3836-471a-b393-f172af9384fe tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:39.508858 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f07778e4-3836-471a-b393-f172af9384fe tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:39.509315 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f07778e4-3836-471a-b393-f172af9384fe tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:39.586489 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-f07778e4-3836-471a-b393-f172af9384fe tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:39.594209 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-f07778e4-3836-471a-b393-f172af9384fe tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c" status: 200 len: 1289 microversion: 2.1 time: 0.101845 Feb 15 14:34:39.594772 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 479/966] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:39 2022] GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c => generated 1289 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:39.988042 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-5918ba45-0610-4a3a-986b-3938def9a0b0 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:39.988748 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-5918ba45-0610-4a3a-986b-3938def9a0b0 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] [instance: 3f7d167b-b2db-4317-9236-c1de2124c54a] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:39.995214 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5918ba45-0610-4a3a-986b-3938def9a0b0 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:39.995719 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5918ba45-0610-4a3a-986b-3938def9a0b0 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:39.996719 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5918ba45-0610-4a3a-986b-3938def9a0b0 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:39.997162 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5918ba45-0610-4a3a-986b-3938def9a0b0 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:40.146757 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-5918ba45-0610-4a3a-986b-3938def9a0b0 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d5800f5af4c6e8cd3811285b36706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cad92425942acb6a714ee8a5bcfa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:40.155423 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-5918ba45-0610-4a3a-986b-3938def9a0b0 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] 10.222.0.83 "GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a" status: 200 len: 1315 microversion: 2.1 time: 0.172237 Feb 15 14:34:40.156440 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 488/967] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:39 2022] GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:40.612091 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-23ebfcb3-e54c-47e9-b92a-44a4d5dcd2a3 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:40.612764 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-23ebfcb3-e54c-47e9-b92a-44a4d5dcd2a3 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 9300405c-2782-49b6-af3f-42c6e8b98e4c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:40.618742 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-23ebfcb3-e54c-47e9-b92a-44a4d5dcd2a3 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:40.619190 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-23ebfcb3-e54c-47e9-b92a-44a4d5dcd2a3 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:40.619971 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-23ebfcb3-e54c-47e9-b92a-44a4d5dcd2a3 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:40.620626 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-23ebfcb3-e54c-47e9-b92a-44a4d5dcd2a3 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:40.804245 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-01822346-75a8-40c0-a27f-b95b75472b42 req-461b9a48-0f9d-4800-bcb8-988c8b2a2020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9300405c-2782-49b6-af3f-42c6e8b98e4c", "tag": "0b7db7d4-e5c9-49d5-b1ee-a1d2ccebbce9"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:34:40.805858 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:34:40.805858 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:34:40.813343 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-01822346-75a8-40c0-a27f-b95b75472b42 req-461b9a48-0f9d-4800-bcb8-988c8b2a2020 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:40.813784 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-01822346-75a8-40c0-a27f-b95b75472b42 req-461b9a48-0f9d-4800-bcb8-988c8b2a2020 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:40.832653 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-01822346-75a8-40c0-a27f-b95b75472b42 req-461b9a48-0f9d-4800-bcb8-988c8b2a2020 service nova] Creating event network-changed:0b7db7d4-e5c9-49d5-b1ee-a1d2ccebbce9 for instance 9300405c-2782-49b6-af3f-42c6e8b98e4c on hv-cinder-81914 Feb 15 14:34:40.838229 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-01822346-75a8-40c0-a27f-b95b75472b42 req-461b9a48-0f9d-4800-bcb8-988c8b2a2020 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037150 Feb 15 14:34:40.839176 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 489/968] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:34:40.854134 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-23ebfcb3-e54c-47e9-b92a-44a4d5dcd2a3 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:40.862742 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-23ebfcb3-e54c-47e9-b92a-44a4d5dcd2a3 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c" status: 200 len: 1319 microversion: 2.1 time: 0.254690 Feb 15 14:34:40.863312 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 480/969] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:40 2022] GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:41.172967 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-c3c99f2d-560b-486f-956f-6b4f6af295ff tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:41.173669 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-c3c99f2d-560b-486f-956f-6b4f6af295ff tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] [instance: 3f7d167b-b2db-4317-9236-c1de2124c54a] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:41.179644 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c3c99f2d-560b-486f-956f-6b4f6af295ff tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:41.180092 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c3c99f2d-560b-486f-956f-6b4f6af295ff tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:41.180895 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c3c99f2d-560b-486f-956f-6b4f6af295ff tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:41.181338 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c3c99f2d-560b-486f-956f-6b4f6af295ff tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:41.320985 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-c3c99f2d-560b-486f-956f-6b4f6af295ff tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d5800f5af4c6e8cd3811285b36706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cad92425942acb6a714ee8a5bcfa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:41.329802 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-c3c99f2d-560b-486f-956f-6b4f6af295ff tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] 10.222.0.83 "GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a" status: 200 len: 1315 microversion: 2.1 time: 0.161397 Feb 15 14:34:41.330390 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 490/970] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:41 2022] GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:41.882591 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-2833e2f8-4d25-4266-8b47-06c7f06263cc tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:41.883206 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-2833e2f8-4d25-4266-8b47-06c7f06263cc tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 9300405c-2782-49b6-af3f-42c6e8b98e4c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:41.889568 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2833e2f8-4d25-4266-8b47-06c7f06263cc tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:41.890016 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2833e2f8-4d25-4266-8b47-06c7f06263cc tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:41.890789 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2833e2f8-4d25-4266-8b47-06c7f06263cc tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:41.891220 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2833e2f8-4d25-4266-8b47-06c7f06263cc tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:42.022343 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-2833e2f8-4d25-4266-8b47-06c7f06263cc tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:42.030173 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-2833e2f8-4d25-4266-8b47-06c7f06263cc tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c" status: 200 len: 1319 microversion: 2.1 time: 0.151281 Feb 15 14:34:42.030674 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 481/971] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:41 2022] GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:42.274497 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-c64bb742-a520-4847-b785-44a649554ad0 req-5f919fb1-3158-486c-9bc3-a3f6191d9214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f7d167b-b2db-4317-9236-c1de2124c54a", "name": "network-vif-plugged", "status": "completed", "tag": "ab426fe5-2e8a-469d-ae87-15470ec35613"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:34:42.276862 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:34:42.276862 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:34:42.285496 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-c64bb742-a520-4847-b785-44a649554ad0 req-5f919fb1-3158-486c-9bc3-a3f6191d9214 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:42.285948 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-c64bb742-a520-4847-b785-44a649554ad0 req-5f919fb1-3158-486c-9bc3-a3f6191d9214 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:42.296950 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-c64bb742-a520-4847-b785-44a649554ad0 req-5f919fb1-3158-486c-9bc3-a3f6191d9214 service nova] Creating event network-vif-plugged:ab426fe5-2e8a-469d-ae87-15470ec35613 for instance 3f7d167b-b2db-4317-9236-c1de2124c54a on hv-cinder-81914 Feb 15 14:34:42.301645 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-c64bb742-a520-4847-b785-44a649554ad0 req-5f919fb1-3158-486c-9bc3-a3f6191d9214 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030789 Feb 15 14:34:42.302252 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 491/972] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:34:42.347367 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-704b66e2-607b-4fb4-a447-5d2a5f52e8b8 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:42.347980 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-704b66e2-607b-4fb4-a447-5d2a5f52e8b8 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] [instance: 3f7d167b-b2db-4317-9236-c1de2124c54a] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:42.354614 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-704b66e2-607b-4fb4-a447-5d2a5f52e8b8 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:42.355301 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-704b66e2-607b-4fb4-a447-5d2a5f52e8b8 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:42.356355 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-704b66e2-607b-4fb4-a447-5d2a5f52e8b8 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:42.357160 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-704b66e2-607b-4fb4-a447-5d2a5f52e8b8 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:42.520178 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-704b66e2-607b-4fb4-a447-5d2a5f52e8b8 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d5800f5af4c6e8cd3811285b36706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cad92425942acb6a714ee8a5bcfa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:42.527339 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-704b66e2-607b-4fb4-a447-5d2a5f52e8b8 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] 10.222.0.83 "GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a" status: 200 len: 1315 microversion: 2.1 time: 0.183721 Feb 15 14:34:42.528813 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 482/973] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:42 2022] GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:43.047337 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-34770152-c029-4758-93e9-99486aac7c70 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:43.048036 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-34770152-c029-4758-93e9-99486aac7c70 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 9300405c-2782-49b6-af3f-42c6e8b98e4c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:43.054144 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-34770152-c029-4758-93e9-99486aac7c70 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:43.054588 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-34770152-c029-4758-93e9-99486aac7c70 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:43.055357 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-34770152-c029-4758-93e9-99486aac7c70 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:43.055791 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-34770152-c029-4758-93e9-99486aac7c70 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:43.187501 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-34770152-c029-4758-93e9-99486aac7c70 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:43.194764 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-34770152-c029-4758-93e9-99486aac7c70 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c" status: 200 len: 1319 microversion: 2.1 time: 0.151824 Feb 15 14:34:43.195340 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 492/974] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:43 2022] GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:43.554848 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-9cd46b38-dfab-45de-b0c5-a54d9fa4082b tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:43.555383 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-9cd46b38-dfab-45de-b0c5-a54d9fa4082b tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] [instance: 3f7d167b-b2db-4317-9236-c1de2124c54a] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:43.562299 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9cd46b38-dfab-45de-b0c5-a54d9fa4082b tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:43.562741 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9cd46b38-dfab-45de-b0c5-a54d9fa4082b tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:43.563502 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9cd46b38-dfab-45de-b0c5-a54d9fa4082b tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:43.563930 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-9cd46b38-dfab-45de-b0c5-a54d9fa4082b tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:43.698639 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-9cd46b38-dfab-45de-b0c5-a54d9fa4082b tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d5800f5af4c6e8cd3811285b36706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cad92425942acb6a714ee8a5bcfa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:43.706737 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-9cd46b38-dfab-45de-b0c5-a54d9fa4082b tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] 10.222.0.83 "GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a" status: 200 len: 1315 microversion: 2.1 time: 0.155632 Feb 15 14:34:43.707306 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 483/975] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:43 2022] GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:44.211724 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-92adf430-aabc-403b-888b-f39b62bbf781 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:44.212252 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-92adf430-aabc-403b-888b-f39b62bbf781 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 9300405c-2782-49b6-af3f-42c6e8b98e4c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:44.219087 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-92adf430-aabc-403b-888b-f39b62bbf781 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:44.219528 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-92adf430-aabc-403b-888b-f39b62bbf781 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:44.220298 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-92adf430-aabc-403b-888b-f39b62bbf781 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:44.220765 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-92adf430-aabc-403b-888b-f39b62bbf781 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:44.362236 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-92adf430-aabc-403b-888b-f39b62bbf781 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:44.369732 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-92adf430-aabc-403b-888b-f39b62bbf781 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c" status: 200 len: 1319 microversion: 2.1 time: 0.161790 Feb 15 14:34:44.370306 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 493/976] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:44 2022] GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:34:44.723024 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-0e60012c-9430-41f8-8d03-74d6983e7b94 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:44.723672 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-0e60012c-9430-41f8-8d03-74d6983e7b94 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] [instance: 3f7d167b-b2db-4317-9236-c1de2124c54a] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:44.730011 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0e60012c-9430-41f8-8d03-74d6983e7b94 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:44.730470 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0e60012c-9430-41f8-8d03-74d6983e7b94 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:44.731402 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0e60012c-9430-41f8-8d03-74d6983e7b94 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:44.731842 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0e60012c-9430-41f8-8d03-74d6983e7b94 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:44.863546 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-0e60012c-9430-41f8-8d03-74d6983e7b94 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d5800f5af4c6e8cd3811285b36706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cad92425942acb6a714ee8a5bcfa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:44.871002 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-0e60012c-9430-41f8-8d03-74d6983e7b94 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] 10.222.0.83 "GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a" status: 200 len: 1464 microversion: 2.1 time: 0.151714 Feb 15 14:34:44.872070 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 484/977] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:44 2022] GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a => generated 1464 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:44.908900 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-863bf2bb-3fb2-4cea-877c-df366e82a4e9 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:44.909389 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-863bf2bb-3fb2-4cea-877c-df366e82a4e9 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] [instance: 3f7d167b-b2db-4317-9236-c1de2124c54a] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:44.915178 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-863bf2bb-3fb2-4cea-877c-df366e82a4e9 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:44.915620 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-863bf2bb-3fb2-4cea-877c-df366e82a4e9 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:44.916441 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-863bf2bb-3fb2-4cea-877c-df366e82a4e9 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:44.916872 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-863bf2bb-3fb2-4cea-877c-df366e82a4e9 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:44.941423 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-863bf2bb-3fb2-4cea-877c-df366e82a4e9 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] [instance: 3f7d167b-b2db-4317-9236-c1de2124c54a] Going to try to terminate instance {{(pid=116363) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 14:34:45.014910 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-863bf2bb-3fb2-4cea-877c-df366e82a4e9 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] 10.222.0.83 "DELETE /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a" status: 204 len: 0 microversion: 2.1 time: 0.109297 Feb 15 14:34:45.015651 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 494/978] 10.222.0.83 () {58 vars in 1238 bytes} [Tue Feb 15 14:34:44 2022] DELETE /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 14:34:45.024195 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-270dcbfa-ed92-4fa7-9176-49ec6a7a76db tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:45.024844 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-270dcbfa-ed92-4fa7-9176-49ec6a7a76db tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] [instance: 3f7d167b-b2db-4317-9236-c1de2124c54a] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:45.030712 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-270dcbfa-ed92-4fa7-9176-49ec6a7a76db tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:45.031165 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-270dcbfa-ed92-4fa7-9176-49ec6a7a76db tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:45.031945 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-270dcbfa-ed92-4fa7-9176-49ec6a7a76db tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:45.032383 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-270dcbfa-ed92-4fa7-9176-49ec6a7a76db tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:45.163394 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-270dcbfa-ed92-4fa7-9176-49ec6a7a76db tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d5800f5af4c6e8cd3811285b36706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cad92425942acb6a714ee8a5bcfa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:45.170718 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-270dcbfa-ed92-4fa7-9176-49ec6a7a76db tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] 10.222.0.83 "GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a" status: 200 len: 1470 microversion: 2.1 time: 0.150554 Feb 15 14:34:45.171284 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 485/979] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:45 2022] GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:45.387065 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-f67c5fc0-8064-432a-b2e3-c1287e0b621e tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:45.387775 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-f67c5fc0-8064-432a-b2e3-c1287e0b621e tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 9300405c-2782-49b6-af3f-42c6e8b98e4c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:45.394329 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f67c5fc0-8064-432a-b2e3-c1287e0b621e tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:45.394772 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f67c5fc0-8064-432a-b2e3-c1287e0b621e tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:45.395537 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f67c5fc0-8064-432a-b2e3-c1287e0b621e tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:45.396004 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-f67c5fc0-8064-432a-b2e3-c1287e0b621e tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:45.529904 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-f67c5fc0-8064-432a-b2e3-c1287e0b621e tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:45.537160 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-f67c5fc0-8064-432a-b2e3-c1287e0b621e tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c" status: 200 len: 1319 microversion: 2.1 time: 0.154374 Feb 15 14:34:45.537728 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 495/980] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:45 2022] GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:46.187358 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-c370e955-d6a6-4487-bc27-43e45f4ad7db tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:46.187970 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-c370e955-d6a6-4487-bc27-43e45f4ad7db tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] [instance: 3f7d167b-b2db-4317-9236-c1de2124c54a] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:46.194707 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c370e955-d6a6-4487-bc27-43e45f4ad7db tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:46.195162 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c370e955-d6a6-4487-bc27-43e45f4ad7db tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:46.196008 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c370e955-d6a6-4487-bc27-43e45f4ad7db tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:46.196656 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c370e955-d6a6-4487-bc27-43e45f4ad7db tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:46.320195 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-e6eb9bdc-eafb-4946-97d1-29694295355e req-1ebc1a14-8158-41fc-a5db-bd2705c36ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9300405c-2782-49b6-af3f-42c6e8b98e4c", "name": "network-vif-plugged", "status": "completed", "tag": "0b7db7d4-e5c9-49d5-b1ee-a1d2ccebbce9"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:34:46.322453 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:34:46.322453 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:34:46.330429 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-e6eb9bdc-eafb-4946-97d1-29694295355e req-1ebc1a14-8158-41fc-a5db-bd2705c36ef7 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:46.330831 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-e6eb9bdc-eafb-4946-97d1-29694295355e req-1ebc1a14-8158-41fc-a5db-bd2705c36ef7 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:46.341294 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-c370e955-d6a6-4487-bc27-43e45f4ad7db tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d5800f5af4c6e8cd3811285b36706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cad92425942acb6a714ee8a5bcfa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:46.347629 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-e6eb9bdc-eafb-4946-97d1-29694295355e req-1ebc1a14-8158-41fc-a5db-bd2705c36ef7 service nova] Creating event network-vif-plugged:0b7db7d4-e5c9-49d5-b1ee-a1d2ccebbce9 for instance 9300405c-2782-49b6-af3f-42c6e8b98e4c on hv-cinder-81914 Feb 15 14:34:46.348948 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-c370e955-d6a6-4487-bc27-43e45f4ad7db tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] 10.222.0.83 "GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a" status: 200 len: 1470 microversion: 2.1 time: 0.165755 Feb 15 14:34:46.349722 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 486/981] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:46 2022] GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:46.352669 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-e6eb9bdc-eafb-4946-97d1-29694295355e req-1ebc1a14-8158-41fc-a5db-bd2705c36ef7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038174 Feb 15 14:34:46.353459 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 496/982] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:34:46.554202 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-45ffcd69-b55f-4fcc-a99c-7a1cc2f270b6 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:46.554837 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-45ffcd69-b55f-4fcc-a99c-7a1cc2f270b6 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 9300405c-2782-49b6-af3f-42c6e8b98e4c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:46.560687 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-45ffcd69-b55f-4fcc-a99c-7a1cc2f270b6 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:46.561227 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-45ffcd69-b55f-4fcc-a99c-7a1cc2f270b6 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:46.562011 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-45ffcd69-b55f-4fcc-a99c-7a1cc2f270b6 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:46.562509 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-45ffcd69-b55f-4fcc-a99c-7a1cc2f270b6 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:46.847217 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-45ffcd69-b55f-4fcc-a99c-7a1cc2f270b6 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:46.854461 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-45ffcd69-b55f-4fcc-a99c-7a1cc2f270b6 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c" status: 200 len: 1319 microversion: 2.1 time: 0.303999 Feb 15 14:34:46.855033 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 487/983] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:46 2022] GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:47.367910 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-2a37d682-5f09-4526-b6ba-48c05025c251 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:47.368647 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-2a37d682-5f09-4526-b6ba-48c05025c251 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] [instance: 3f7d167b-b2db-4317-9236-c1de2124c54a] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:47.375162 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2a37d682-5f09-4526-b6ba-48c05025c251 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:47.375619 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2a37d682-5f09-4526-b6ba-48c05025c251 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:47.376419 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2a37d682-5f09-4526-b6ba-48c05025c251 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:47.376877 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-2a37d682-5f09-4526-b6ba-48c05025c251 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:47.516516 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-2a37d682-5f09-4526-b6ba-48c05025c251 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d5800f5af4c6e8cd3811285b36706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cad92425942acb6a714ee8a5bcfa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:47.524965 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-2a37d682-5f09-4526-b6ba-48c05025c251 tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] 10.222.0.83 "GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a" status: 200 len: 1470 microversion: 2.1 time: 0.161514 Feb 15 14:34:47.525557 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 497/984] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:47 2022] GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:47.600387 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-609ac662-420b-493d-9fbc-257e244a9bf0 req-a6062e71-f2bc-4a9e-8d7a-b1cb7219bf47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f7d167b-b2db-4317-9236-c1de2124c54a", "name": "network-vif-deleted", "tag": "ab426fe5-2e8a-469d-ae87-15470ec35613"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:34:47.602103 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:34:47.602103 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:34:47.609836 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-609ac662-420b-493d-9fbc-257e244a9bf0 req-a6062e71-f2bc-4a9e-8d7a-b1cb7219bf47 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:47.610275 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-609ac662-420b-493d-9fbc-257e244a9bf0 req-a6062e71-f2bc-4a9e-8d7a-b1cb7219bf47 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:47.627359 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-609ac662-420b-493d-9fbc-257e244a9bf0 req-a6062e71-f2bc-4a9e-8d7a-b1cb7219bf47 service nova] Creating event network-vif-deleted:ab426fe5-2e8a-469d-ae87-15470ec35613 for instance 3f7d167b-b2db-4317-9236-c1de2124c54a on hv-cinder-81914 Feb 15 14:34:47.632389 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-609ac662-420b-493d-9fbc-257e244a9bf0 req-a6062e71-f2bc-4a9e-8d7a-b1cb7219bf47 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035860 Feb 15 14:34:47.633030 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 488/985] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:34:47.870834 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-01d7bfeb-2fec-4453-a724-58431f485caa tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:47.872121 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-01d7bfeb-2fec-4453-a724-58431f485caa tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 9300405c-2782-49b6-af3f-42c6e8b98e4c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:47.878201 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-01d7bfeb-2fec-4453-a724-58431f485caa tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:47.878651 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-01d7bfeb-2fec-4453-a724-58431f485caa tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:47.879434 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-01d7bfeb-2fec-4453-a724-58431f485caa tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:47.879870 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-01d7bfeb-2fec-4453-a724-58431f485caa tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:48.014974 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-01d7bfeb-2fec-4453-a724-58431f485caa tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:48.022604 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-01d7bfeb-2fec-4453-a724-58431f485caa tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c" status: 200 len: 1319 microversion: 2.1 time: 0.155428 Feb 15 14:34:48.023254 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 498/986] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:47 2022] GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:34:48.542846 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-59d94da5-ebcb-41a6-8be5-2f505e9cc47a tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:48.544048 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-59d94da5-ebcb-41a6-8be5-2f505e9cc47a tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] [instance: 3f7d167b-b2db-4317-9236-c1de2124c54a] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:48.550213 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-59d94da5-ebcb-41a6-8be5-2f505e9cc47a tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:48.550668 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-59d94da5-ebcb-41a6-8be5-2f505e9cc47a tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:48.551441 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-59d94da5-ebcb-41a6-8be5-2f505e9cc47a tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:48.551877 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-59d94da5-ebcb-41a6-8be5-2f505e9cc47a tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:48.565254 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.wsgi [None req-59d94da5-ebcb-41a6-8be5-2f505e9cc47a tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] HTTP exception thrown: Instance 3f7d167b-b2db-4317-9236-c1de2124c54a could not be found. Feb 15 14:34:48.565837 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-59d94da5-ebcb-41a6-8be5-2f505e9cc47a tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] Returning 404 to user: Instance 3f7d167b-b2db-4317-9236-c1de2124c54a could not be found. {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:34:48.566651 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-59d94da5-ebcb-41a6-8be5-2f505e9cc47a tempest-VolumesNegativeTest-1939225081 tempest-VolumesNegativeTest-1939225081-project] 10.222.0.83 "GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a" status: 404 len: 111 microversion: 2.1 time: 0.027807 Feb 15 14:34:48.567170 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 489/987] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:48 2022] GET /compute/v2.1/servers/3f7d167b-b2db-4317-9236-c1de2124c54a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:34:49.040091 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-e4fb4399-cffb-4395-9cdf-223b92ee7161 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:34:49.040818 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-e4fb4399-cffb-4395-9cdf-223b92ee7161 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 9300405c-2782-49b6-af3f-42c6e8b98e4c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:49.047118 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e4fb4399-cffb-4395-9cdf-223b92ee7161 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:49.047564 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e4fb4399-cffb-4395-9cdf-223b92ee7161 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:49.048343 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e4fb4399-cffb-4395-9cdf-223b92ee7161 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:49.048805 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e4fb4399-cffb-4395-9cdf-223b92ee7161 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:49.193085 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-e4fb4399-cffb-4395-9cdf-223b92ee7161 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:34:49.200653 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-e4fb4399-cffb-4395-9cdf-223b92ee7161 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c" status: 200 len: 1508 microversion: 2.1 time: 0.164593 Feb 15 14:34:49.201105 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 499/988] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:34:49 2022] GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:34:49.217383 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-7801a319-e23b-4305-8cd7-1bf5b1e5a4e2 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10ab51f1-280c-4f8b-8363-e858f8c7c9aa", "device": "/dev/sdb"}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:34:49.218524 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-7801a319-e23b-4305-8cd7-1bf5b1e5a4e2 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 9300405c-2782-49b6-af3f-42c6e8b98e4c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:34:49.225163 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7801a319-e23b-4305-8cd7-1bf5b1e5a4e2 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:49.225614 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7801a319-e23b-4305-8cd7-1bf5b1e5a4e2 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:49.226397 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7801a319-e23b-4305-8cd7-1bf5b1e5a4e2 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:34:49.226833 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7801a319-e23b-4305-8cd7-1bf5b1e5a4e2 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:34:49.467292 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-7801a319-e23b-4305-8cd7-1bf5b1e5a4e2 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "POST /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254533 Feb 15 14:34:49.467950 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 490/989] 10.222.0.83 () {60 vars in 1322 bytes} [Tue Feb 15 14:34:49 2022] POST /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:35:08.679756 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-67fdc4e6-60d8-488c-8833-1bc985422f45 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:35:08.680289 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-67fdc4e6-60d8-488c-8833-1bc985422f45 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 9300405c-2782-49b6-af3f-42c6e8b98e4c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:35:08.686996 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-67fdc4e6-60d8-488c-8833-1bc985422f45 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:35:08.687440 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-67fdc4e6-60d8-488c-8833-1bc985422f45 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:35:08.688205 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-67fdc4e6-60d8-488c-8833-1bc985422f45 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:35:08.688672 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-67fdc4e6-60d8-488c-8833-1bc985422f45 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:35:08.763917 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.objects.instance [None req-67fdc4e6-60d8-488c-8833-1bc985422f45 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lazy-loading 'services' on Instance uuid 9300405c-2782-49b6-af3f-42c6e8b98e4c {{(pid=116363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:35:08.831102 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-67fdc4e6-60d8-488c-8833-1bc985422f45 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c/os-volume_attachments/10ab51f1-280c-4f8b-8363-e858f8c7c9aa" status: 202 len: 0 microversion: 2.1 time: 0.155025 Feb 15 14:35:08.831729 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 500/990] 10.222.0.83 () {58 vars in 1415 bytes} [Tue Feb 15 14:35:08 2022] DELETE /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c/os-volume_attachments/10ab51f1-280c-4f8b-8363-e858f8c7c9aa => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:35:09.938174 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-cadf700f-7b4d-41d9-b9ea-826b2af3fa9f tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:35:09.938761 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-cadf700f-7b4d-41d9-b9ea-826b2af3fa9f tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 9300405c-2782-49b6-af3f-42c6e8b98e4c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:35:09.944949 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cadf700f-7b4d-41d9-b9ea-826b2af3fa9f tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:35:09.945404 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cadf700f-7b4d-41d9-b9ea-826b2af3fa9f tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:35:09.946183 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cadf700f-7b4d-41d9-b9ea-826b2af3fa9f tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:35:09.946622 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cadf700f-7b4d-41d9-b9ea-826b2af3fa9f tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:35:09.970881 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-cadf700f-7b4d-41d9-b9ea-826b2af3fa9f tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 9300405c-2782-49b6-af3f-42c6e8b98e4c] Going to try to terminate instance {{(pid=116362) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 14:35:10.045691 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-cadf700f-7b4d-41d9-b9ea-826b2af3fa9f tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c" status: 204 len: 0 microversion: 2.1 time: 0.111976 Feb 15 14:35:10.046539 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 491/991] 10.222.0.83 () {58 vars in 1238 bytes} [Tue Feb 15 14:35:09 2022] DELETE /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 14:35:10.055533 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-25693bee-4b7a-4af6-b833-c5dba9f074ec tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:35:10.056229 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-25693bee-4b7a-4af6-b833-c5dba9f074ec tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 9300405c-2782-49b6-af3f-42c6e8b98e4c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:35:10.063226 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-25693bee-4b7a-4af6-b833-c5dba9f074ec tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:35:10.063703 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-25693bee-4b7a-4af6-b833-c5dba9f074ec tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:35:10.064637 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-25693bee-4b7a-4af6-b833-c5dba9f074ec tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:35:10.065079 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-25693bee-4b7a-4af6-b833-c5dba9f074ec tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:35:10.197881 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-25693bee-4b7a-4af6-b833-c5dba9f074ec tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:35:10.205462 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-25693bee-4b7a-4af6-b833-c5dba9f074ec tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c" status: 200 len: 1514 microversion: 2.1 time: 0.154399 Feb 15 14:35:10.206034 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 501/992] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:35:10 2022] GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:35:11.223186 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-d4bd0955-4d29-4852-a14a-2f98b3379bc3 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:35:11.223794 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-d4bd0955-4d29-4852-a14a-2f98b3379bc3 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 9300405c-2782-49b6-af3f-42c6e8b98e4c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:35:11.229965 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d4bd0955-4d29-4852-a14a-2f98b3379bc3 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:35:11.230410 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d4bd0955-4d29-4852-a14a-2f98b3379bc3 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:35:11.232052 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d4bd0955-4d29-4852-a14a-2f98b3379bc3 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:35:11.232507 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d4bd0955-4d29-4852-a14a-2f98b3379bc3 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:35:11.366326 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-d4bd0955-4d29-4852-a14a-2f98b3379bc3 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:35:11.373701 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-d4bd0955-4d29-4852-a14a-2f98b3379bc3 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c" status: 200 len: 1514 microversion: 2.1 time: 0.154671 Feb 15 14:35:11.374256 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 492/993] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:35:11 2022] GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:35:12.314387 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-bf0bb343-10d9-422a-9002-5d65a02050c4 req-e7b83e02-e460-473f-8e92-0decf189a6df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9300405c-2782-49b6-af3f-42c6e8b98e4c", "name": "network-vif-deleted", "tag": "0b7db7d4-e5c9-49d5-b1ee-a1d2ccebbce9"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:35:12.316478 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:35:12.316478 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:35:12.323929 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-bf0bb343-10d9-422a-9002-5d65a02050c4 req-e7b83e02-e460-473f-8e92-0decf189a6df service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:35:12.324377 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-bf0bb343-10d9-422a-9002-5d65a02050c4 req-e7b83e02-e460-473f-8e92-0decf189a6df service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:35:12.337733 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-bf0bb343-10d9-422a-9002-5d65a02050c4 req-e7b83e02-e460-473f-8e92-0decf189a6df service nova] Creating event network-vif-deleted:0b7db7d4-e5c9-49d5-b1ee-a1d2ccebbce9 for instance 9300405c-2782-49b6-af3f-42c6e8b98e4c on hv-cinder-81914 Feb 15 14:35:12.342927 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-bf0bb343-10d9-422a-9002-5d65a02050c4 req-e7b83e02-e460-473f-8e92-0decf189a6df service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032121 Feb 15 14:35:12.343509 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 502/994] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:35:12.391779 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-bda390a9-89de-4101-ade5-a84844f83379 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:35:12.393351 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-bda390a9-89de-4101-ade5-a84844f83379 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 9300405c-2782-49b6-af3f-42c6e8b98e4c] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:35:12.400805 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bda390a9-89de-4101-ade5-a84844f83379 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:35:12.401265 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bda390a9-89de-4101-ade5-a84844f83379 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:35:12.402270 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bda390a9-89de-4101-ade5-a84844f83379 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:35:12.403076 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bda390a9-89de-4101-ade5-a84844f83379 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:35:12.441292 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bda390a9-89de-4101-ade5-a84844f83379 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:35:12.441749 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-bda390a9-89de-4101-ade5-a84844f83379 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:35:12.442492 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.objects.instance [None req-bda390a9-89de-4101-ade5-a84844f83379 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lazy-loading 'fault' on Instance uuid 9300405c-2782-49b6-af3f-42c6e8b98e4c {{(pid=116362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:35:12.482345 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-bda390a9-89de-4101-ade5-a84844f83379 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91a680236734dddb8c5fd1dfaebd60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9494e5cf9042de869b6a3d9505d51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:35:12.489895 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-bda390a9-89de-4101-ade5-a84844f83379 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c" status: 200 len: 1309 microversion: 2.1 time: 0.103161 Feb 15 14:35:12.490465 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 493/995] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:35:12 2022] GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:35:13.508447 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-78fad0a6-fb1c-4a82-9540-2c4bacb422f8 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:35:13.509151 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-78fad0a6-fb1c-4a82-9540-2c4bacb422f8 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] [instance: 9300405c-2782-49b6-af3f-42c6e8b98e4c] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:35:13.516141 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-78fad0a6-fb1c-4a82-9540-2c4bacb422f8 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:35:13.516630 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-78fad0a6-fb1c-4a82-9540-2c4bacb422f8 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:35:13.517416 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-78fad0a6-fb1c-4a82-9540-2c4bacb422f8 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:35:13.518150 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-78fad0a6-fb1c-4a82-9540-2c4bacb422f8 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:35:13.531247 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.wsgi [None req-78fad0a6-fb1c-4a82-9540-2c4bacb422f8 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] HTTP exception thrown: Instance 9300405c-2782-49b6-af3f-42c6e8b98e4c could not be found. Feb 15 14:35:13.531829 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-78fad0a6-fb1c-4a82-9540-2c4bacb422f8 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] Returning 404 to user: Instance 9300405c-2782-49b6-af3f-42c6e8b98e4c could not be found. {{(pid=116363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:35:13.532673 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-78fad0a6-fb1c-4a82-9540-2c4bacb422f8 tempest-VolumesSnapshotTestJSON-1633941236 tempest-VolumesSnapshotTestJSON-1633941236-project] 10.222.0.83 "GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c" status: 404 len: 111 microversion: 2.1 time: 0.028717 Feb 15 14:35:13.533212 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 503/996] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:35:13 2022] GET /compute/v2.1/servers/9300405c-2782-49b6-af3f-42c6e8b98e4c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:35:47.039579 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-03f96893-569a-4e7e-a37f-079dbd66c985 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Action: 'create', calling method: .version_select at 0x7fd74fe72280>, body: {"keypair": {"name": "tempest-TestShelveInstance-405284085"}} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:35:47.053691 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-03f96893-569a-4e7e-a37f-079dbd66c985 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Getting quotas for project 3bdb0c0982ff455995348e781d9728b9. Resources: {'key_pairs'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:35:47.057519 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-03f96893-569a-4e7e-a37f-079dbd66c985 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Getting quotas for user a3e47f21c8fa459292203942290e4eca and project 3bdb0c0982ff455995348e781d9728b9. Resources: {'key_pairs'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:35:47.227940 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-03f96893-569a-4e7e-a37f-079dbd66c985 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Getting quotas for project 3bdb0c0982ff455995348e781d9728b9. Resources: {'key_pairs'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:35:47.232552 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.quota [None req-03f96893-569a-4e7e-a37f-079dbd66c985 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Getting quotas for user a3e47f21c8fa459292203942290e4eca and project 3bdb0c0982ff455995348e781d9728b9. Resources: {'key_pairs'} {{(pid=116362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:35:47.245339 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-03f96893-569a-4e7e-a37f-079dbd66c985 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.366877 Feb 15 14:35:47.246056 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 494/997] 10.222.0.83 () {60 vars in 1157 bytes} [Tue Feb 15 14:35:46 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:36:03.393371 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-e25cd288-7ab9-4730-929d-4af47bb17b02 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1381228732", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-405284085", "security_groups": [{"name": "tempest-secgroup-smoke-312825029"}], "networks": [{"uuid": "d1752316-c19e-41a9-80c5-7135dcea57c9"}], "block_device_mapping_v2": [{"uuid": "6e292684-47d9-4590-9b88-5b0caf152a69", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:36:03.502197 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.network.neutron [None req-e25cd288-7ab9-4730-929d-4af47bb17b02 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] validate_networks() for [('d1752316-c19e-41a9-80c5-7135dcea57c9', None, None, None, None, None)] {{(pid=116363) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 14:36:03.864804 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-e25cd288-7ab9-4730-929d-4af47bb17b02 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Flavor limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 14:36:03.865222 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-e25cd288-7ab9-4730-929d-4af47bb17b02 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Image limits 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 14:36:03.865693 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-e25cd288-7ab9-4730-929d-4af47bb17b02 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Flavor pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 14:36:03.866098 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-e25cd288-7ab9-4730-929d-4af47bb17b02 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Image pref 0:0:0 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 14:36:03.866503 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.virt.hardware [None req-e25cd288-7ab9-4730-929d-4af47bb17b02 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 14:36:03.876076 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e25cd288-7ab9-4730-929d-4af47bb17b02 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:03.876548 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e25cd288-7ab9-4730-929d-4af47bb17b02 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:03.877357 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e25cd288-7ab9-4730-929d-4af47bb17b02 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:03.877787 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e25cd288-7ab9-4730-929d-4af47bb17b02 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:03.893962 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-e25cd288-7ab9-4730-929d-4af47bb17b02 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Getting quotas for project 3bdb0c0982ff455995348e781d9728b9. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 14:36:03.897828 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.quota [None req-e25cd288-7ab9-4730-929d-4af47bb17b02 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Getting quotas for user a3e47f21c8fa459292203942290e4eca and project 3bdb0c0982ff455995348e781d9728b9. Resources: {'instances', 'ram', 'cores'} {{(pid=116363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 14:36:03.951925 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-e25cd288-7ab9-4730-929d-4af47bb17b02 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Going to run 1 instances... {{(pid=116363) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 14:36:03.954084 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-e25cd288-7ab9-4730-929d-4af47bb17b02 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6e292684-47d9-4590-9b88-5b0caf152a69',volume_size=None,volume_type=None)] {{(pid=116363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 14:36:04.073122 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-e25cd288-7ab9-4730-929d-4af47bb17b02 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.683459 Feb 15 14:36:04.073807 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 504/998] 10.222.0.83 () {60 vars in 1146 bytes} [Tue Feb 15 14:36:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 14:36:04.084266 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-031e84c8-543a-4b9d-91dd-a5aa7a934189 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:04.084934 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-031e84c8-543a-4b9d-91dd-a5aa7a934189 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:04.138150 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-031e84c8-543a-4b9d-91dd-a5aa7a934189 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:36:04.145753 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-031e84c8-543a-4b9d-91dd-a5aa7a934189 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1088 microversion: 2.1 time: 0.065728 Feb 15 14:36:04.148545 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 495/999] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:36:04 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1088 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:36:05.215476 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-1ead45a2-b06f-4ff8-b34c-f941b62342bd tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:05.216718 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-1ead45a2-b06f-4ff8-b34c-f941b62342bd tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:05.222973 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1ead45a2-b06f-4ff8-b34c-f941b62342bd tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:05.223421 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1ead45a2-b06f-4ff8-b34c-f941b62342bd tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:05.224248 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1ead45a2-b06f-4ff8-b34c-f941b62342bd tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:05.224666 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1ead45a2-b06f-4ff8-b34c-f941b62342bd tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:05.290303 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-1ead45a2-b06f-4ff8-b34c-f941b62342bd tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:36:05.298485 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-1ead45a2-b06f-4ff8-b34c-f941b62342bd tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1204 microversion: 2.1 time: 0.087386 Feb 15 14:36:05.299064 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 505/1000] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:36:05 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1204 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:36:06.315329 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-33a76c01-d8a7-44a5-908a-22f305319170 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:06.317270 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-33a76c01-d8a7-44a5-908a-22f305319170 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:06.324752 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-33a76c01-d8a7-44a5-908a-22f305319170 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:06.325882 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-33a76c01-d8a7-44a5-908a-22f305319170 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:06.326947 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-33a76c01-d8a7-44a5-908a-22f305319170 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:06.327664 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-33a76c01-d8a7-44a5-908a-22f305319170 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:06.545666 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-33a76c01-d8a7-44a5-908a-22f305319170 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:36:06.552913 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-33a76c01-d8a7-44a5-908a-22f305319170 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1259 microversion: 2.1 time: 0.241491 Feb 15 14:36:06.553478 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 496/1001] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:36:06 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1259 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:36:06.691885 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-1fe77996-f63b-4d08-875b-c7a78550477a req-83c609ed-c367-4414-b847-1d9a533c201e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "062d0093-cd36-49fd-8b0d-0d0029fc6d77", "tag": "74b413c9-27f5-42a4-a146-b9beb93af473"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:36:06.694147 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:36:06.694147 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:36:06.701591 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-1fe77996-f63b-4d08-875b-c7a78550477a req-83c609ed-c367-4414-b847-1d9a533c201e service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:06.702043 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-1fe77996-f63b-4d08-875b-c7a78550477a req-83c609ed-c367-4414-b847-1d9a533c201e service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:06.713660 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-1fe77996-f63b-4d08-875b-c7a78550477a req-83c609ed-c367-4414-b847-1d9a533c201e service nova] Creating event network-changed:74b413c9-27f5-42a4-a146-b9beb93af473 for instance 062d0093-cd36-49fd-8b0d-0d0029fc6d77 on hv-cinder-81914 Feb 15 14:36:06.719338 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-1fe77996-f63b-4d08-875b-c7a78550477a req-83c609ed-c367-4414-b847-1d9a533c201e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111271 Feb 15 14:36:06.719998 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 506/1002] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:36:07.570782 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-c2c3a31e-a197-42ba-9058-3985e8ceb679 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:07.571390 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-c2c3a31e-a197-42ba-9058-3985e8ceb679 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:07.578484 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c2c3a31e-a197-42ba-9058-3985e8ceb679 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:07.578926 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c2c3a31e-a197-42ba-9058-3985e8ceb679 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:07.579694 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c2c3a31e-a197-42ba-9058-3985e8ceb679 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:07.580128 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c2c3a31e-a197-42ba-9058-3985e8ceb679 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:07.716971 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-c2c3a31e-a197-42ba-9058-3985e8ceb679 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:36:07.724341 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-c2c3a31e-a197-42ba-9058-3985e8ceb679 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1259 microversion: 2.1 time: 0.157182 Feb 15 14:36:07.724932 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 497/1003] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:36:07 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:36:07.921335 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 14:36:07.921839 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: Tue Feb 15 14:36:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 14:36:08.742583 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-0b3c0810-d4f1-4b08-b155-3bb728b1f0b0 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:08.743201 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-0b3c0810-d4f1-4b08-b155-3bb728b1f0b0 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:08.749779 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0b3c0810-d4f1-4b08-b155-3bb728b1f0b0 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:08.750226 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0b3c0810-d4f1-4b08-b155-3bb728b1f0b0 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:08.750998 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0b3c0810-d4f1-4b08-b155-3bb728b1f0b0 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:08.751430 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0b3c0810-d4f1-4b08-b155-3bb728b1f0b0 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:08.890421 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-0b3c0810-d4f1-4b08-b155-3bb728b1f0b0 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:36:08.898090 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-0b3c0810-d4f1-4b08-b155-3bb728b1f0b0 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1259 microversion: 2.1 time: 0.160089 Feb 15 14:36:08.898651 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 507/1004] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:36:08 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:36:09.914529 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-49f1f83a-32da-463a-bde7-2966370ae517 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:09.915147 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-49f1f83a-32da-463a-bde7-2966370ae517 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:09.922618 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-49f1f83a-32da-463a-bde7-2966370ae517 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:09.923296 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-49f1f83a-32da-463a-bde7-2966370ae517 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:09.924318 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-49f1f83a-32da-463a-bde7-2966370ae517 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:09.924785 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-49f1f83a-32da-463a-bde7-2966370ae517 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:10.055525 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-49f1f83a-32da-463a-bde7-2966370ae517 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:36:10.062797 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-49f1f83a-32da-463a-bde7-2966370ae517 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1259 microversion: 2.1 time: 0.151974 Feb 15 14:36:10.063353 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 498/1005] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:36:09 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:36:11.079555 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-981d1863-f235-42b0-84b1-35283fe49f1d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:11.080167 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-981d1863-f235-42b0-84b1-35283fe49f1d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:11.086461 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-981d1863-f235-42b0-84b1-35283fe49f1d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:11.086900 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-981d1863-f235-42b0-84b1-35283fe49f1d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:11.087660 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-981d1863-f235-42b0-84b1-35283fe49f1d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:11.088091 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-981d1863-f235-42b0-84b1-35283fe49f1d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:11.222745 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-981d1863-f235-42b0-84b1-35283fe49f1d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:36:11.230018 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-981d1863-f235-42b0-84b1-35283fe49f1d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1259 microversion: 2.1 time: 0.154860 Feb 15 14:36:11.230574 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 508/1006] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:36:11 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:36:12.246860 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-25d936a5-d225-4f2c-ad82-f7d244a9d76f tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:12.248052 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-25d936a5-d225-4f2c-ad82-f7d244a9d76f tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:12.254390 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-25d936a5-d225-4f2c-ad82-f7d244a9d76f tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:12.254835 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-25d936a5-d225-4f2c-ad82-f7d244a9d76f tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:12.255597 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-25d936a5-d225-4f2c-ad82-f7d244a9d76f tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:12.256029 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-25d936a5-d225-4f2c-ad82-f7d244a9d76f tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:12.388335 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-25d936a5-d225-4f2c-ad82-f7d244a9d76f tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:36:12.395844 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-25d936a5-d225-4f2c-ad82-f7d244a9d76f tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1259 microversion: 2.1 time: 0.152827 Feb 15 14:36:12.396421 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 499/1007] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:36:12 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:36:13.412948 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-ffcdf095-c9ca-45b5-a11d-495cd8668c60 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:13.413550 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-ffcdf095-c9ca-45b5-a11d-495cd8668c60 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:13.419953 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ffcdf095-c9ca-45b5-a11d-495cd8668c60 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:13.420395 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ffcdf095-c9ca-45b5-a11d-495cd8668c60 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:13.421186 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ffcdf095-c9ca-45b5-a11d-495cd8668c60 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:13.421613 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-ffcdf095-c9ca-45b5-a11d-495cd8668c60 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:13.563112 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-ffcdf095-c9ca-45b5-a11d-495cd8668c60 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:36:13.570501 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-ffcdf095-c9ca-45b5-a11d-495cd8668c60 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1259 microversion: 2.1 time: 0.161276 Feb 15 14:36:13.571070 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 509/1008] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:36:13 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:36:14.588024 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-6a3fad6c-0887-4fb2-8c21-49d1d59dc79d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:14.588762 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-6a3fad6c-0887-4fb2-8c21-49d1d59dc79d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:14.595716 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6a3fad6c-0887-4fb2-8c21-49d1d59dc79d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:14.596166 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6a3fad6c-0887-4fb2-8c21-49d1d59dc79d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:14.596975 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6a3fad6c-0887-4fb2-8c21-49d1d59dc79d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:14.597414 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-6a3fad6c-0887-4fb2-8c21-49d1d59dc79d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:14.734317 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-6a3fad6c-0887-4fb2-8c21-49d1d59dc79d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:36:14.741673 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-6a3fad6c-0887-4fb2-8c21-49d1d59dc79d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1259 microversion: 2.1 time: 0.157386 Feb 15 14:36:14.742241 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 500/1009] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:36:14 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:36:15.758238 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-1a05ee53-92fe-410a-b4ca-d9664b142443 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:15.758874 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-1a05ee53-92fe-410a-b4ca-d9664b142443 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:15.765073 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1a05ee53-92fe-410a-b4ca-d9664b142443 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:15.765514 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1a05ee53-92fe-410a-b4ca-d9664b142443 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:15.766275 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1a05ee53-92fe-410a-b4ca-d9664b142443 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:15.766705 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-1a05ee53-92fe-410a-b4ca-d9664b142443 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:15.905912 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-1a05ee53-92fe-410a-b4ca-d9664b142443 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:36:15.913573 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-1a05ee53-92fe-410a-b4ca-d9664b142443 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1259 microversion: 2.1 time: 0.159066 Feb 15 14:36:15.914149 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 510/1010] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:36:15 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:36:16.934217 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-a98be026-26fb-4606-8c67-21418ec322bb tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:16.935712 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-a98be026-26fb-4606-8c67-21418ec322bb tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:16.941983 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a98be026-26fb-4606-8c67-21418ec322bb tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:16.942440 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a98be026-26fb-4606-8c67-21418ec322bb tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:16.943220 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a98be026-26fb-4606-8c67-21418ec322bb tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:16.943657 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-a98be026-26fb-4606-8c67-21418ec322bb tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:16.998122 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-335e8c52-ec2b-4763-927a-0706f4c40941 req-e7d11b4e-ae72-4d78-9161-04d9654b9ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "062d0093-cd36-49fd-8b0d-0d0029fc6d77", "name": "network-vif-plugged", "status": "completed", "tag": "74b413c9-27f5-42a4-a146-b9beb93af473"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:36:16.999634 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:36:16.999634 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:36:17.006928 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-335e8c52-ec2b-4763-927a-0706f4c40941 req-e7d11b4e-ae72-4d78-9161-04d9654b9ad0 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:17.007410 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-335e8c52-ec2b-4763-927a-0706f4c40941 req-e7d11b4e-ae72-4d78-9161-04d9654b9ad0 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:17.020564 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-335e8c52-ec2b-4763-927a-0706f4c40941 req-e7d11b4e-ae72-4d78-9161-04d9654b9ad0 service nova] Creating event network-vif-plugged:74b413c9-27f5-42a4-a146-b9beb93af473 for instance 062d0093-cd36-49fd-8b0d-0d0029fc6d77 on hv-cinder-81914 Feb 15 14:36:17.026231 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-335e8c52-ec2b-4763-927a-0706f4c40941 req-e7d11b4e-ae72-4d78-9161-04d9654b9ad0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107981 Feb 15 14:36:17.027066 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 501/1011] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:36:17.081829 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-a98be026-26fb-4606-8c67-21418ec322bb tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:36:17.089115 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-a98be026-26fb-4606-8c67-21418ec322bb tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1259 microversion: 2.1 time: 0.162712 Feb 15 14:36:17.089682 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 511/1012] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:36:16 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:36:18.106888 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-cb40df6d-6058-4f1d-916c-94ef384e683f tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:18.107582 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-cb40df6d-6058-4f1d-916c-94ef384e683f tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:18.113685 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cb40df6d-6058-4f1d-916c-94ef384e683f tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:18.114131 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cb40df6d-6058-4f1d-916c-94ef384e683f tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:18.114904 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cb40df6d-6058-4f1d-916c-94ef384e683f tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:18.115335 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cb40df6d-6058-4f1d-916c-94ef384e683f tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:18.253222 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-cb40df6d-6058-4f1d-916c-94ef384e683f tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:36:18.260448 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-cb40df6d-6058-4f1d-916c-94ef384e683f tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1259 microversion: 2.1 time: 0.158139 Feb 15 14:36:18.261007 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 502/1013] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:36:18 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:36:19.277787 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-e254d1e1-8c07-4fa4-b4e2-8cb24fcb0e45 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:19.278497 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-e254d1e1-8c07-4fa4-b4e2-8cb24fcb0e45 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:19.284805 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e254d1e1-8c07-4fa4-b4e2-8cb24fcb0e45 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:19.285247 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e254d1e1-8c07-4fa4-b4e2-8cb24fcb0e45 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:19.286029 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e254d1e1-8c07-4fa4-b4e2-8cb24fcb0e45 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:19.286458 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-e254d1e1-8c07-4fa4-b4e2-8cb24fcb0e45 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:19.424803 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-e254d1e1-8c07-4fa4-b4e2-8cb24fcb0e45 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:36:19.432228 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-e254d1e1-8c07-4fa4-b4e2-8cb24fcb0e45 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1443 microversion: 2.1 time: 0.158198 Feb 15 14:36:19.432822 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 512/1014] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:36:19 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:36:19.447887 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-1708d9e1-a86d-475c-9167-4ec59afce82a tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:19.448554 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-1708d9e1-a86d-475c-9167-4ec59afce82a tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:19.454802 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1708d9e1-a86d-475c-9167-4ec59afce82a tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:19.455252 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1708d9e1-a86d-475c-9167-4ec59afce82a tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:19.456031 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1708d9e1-a86d-475c-9167-4ec59afce82a tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:19.456497 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-1708d9e1-a86d-475c-9167-4ec59afce82a tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:19.588747 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-1708d9e1-a86d-475c-9167-4ec59afce82a tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:36:19.596269 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-1708d9e1-a86d-475c-9167-4ec59afce82a tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1443 microversion: 2.1 time: 0.152032 Feb 15 14:36:19.596856 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 503/1015] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:36:19 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:36:20.529503 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-6f9ae413-87f1-428b-80d2-343309208fb0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:20.530666 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-6f9ae413-87f1-428b-80d2-343309208fb0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: c4b3e2c3-075a-4d59-b6b1-c399c86de60f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:20.531573 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-fd0b0e42-a14b-472b-bf61-b1b90570de50 req-9dfa1520-3d41-4aad-a143-0f47ee220e21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b3e2c3-075a-4d59-b6b1-c399c86de60f", "tag": "b1fceff6-3d3d-4ab3-a0dc-f4e8cfeb62a8"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:36:20.533151 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:36:20.533151 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:36:20.538913 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6f9ae413-87f1-428b-80d2-343309208fb0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:20.539470 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6f9ae413-87f1-428b-80d2-343309208fb0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:20.540615 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6f9ae413-87f1-428b-80d2-343309208fb0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:20.541162 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-6f9ae413-87f1-428b-80d2-343309208fb0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:20.544091 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-fd0b0e42-a14b-472b-bf61-b1b90570de50 req-9dfa1520-3d41-4aad-a143-0f47ee220e21 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:20.544569 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-fd0b0e42-a14b-472b-bf61-b1b90570de50 req-9dfa1520-3d41-4aad-a143-0f47ee220e21 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:20.567387 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-fd0b0e42-a14b-472b-bf61-b1b90570de50 req-9dfa1520-3d41-4aad-a143-0f47ee220e21 service nova] Creating event network-changed:b1fceff6-3d3d-4ab3-a0dc-f4e8cfeb62a8 for instance c4b3e2c3-075a-4d59-b6b1-c399c86de60f on hv-cinder-81914 Feb 15 14:36:20.569482 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-6f9ae413-87f1-428b-80d2-343309208fb0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: c4b3e2c3-075a-4d59-b6b1-c399c86de60f] Going to try to terminate instance {{(pid=116363) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 14:36:20.574334 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-fd0b0e42-a14b-472b-bf61-b1b90570de50 req-9dfa1520-3d41-4aad-a143-0f47ee220e21 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045751 Feb 15 14:36:20.579737 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 504/1016] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:36:20.665638 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-6f9ae413-87f1-428b-80d2-343309208fb0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "DELETE /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f" status: 204 len: 0 microversion: 2.1 time: 0.140388 Feb 15 14:36:20.670310 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 513/1017] 10.222.0.83 () {58 vars in 1238 bytes} [Tue Feb 15 14:36:20 2022] DELETE /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 15 14:36:20.676327 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-d64a97b3-2f7f-4181-9a86-2a544cde2b83 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:20.681142 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-d64a97b3-2f7f-4181-9a86-2a544cde2b83 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: c4b3e2c3-075a-4d59-b6b1-c399c86de60f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:20.688601 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d64a97b3-2f7f-4181-9a86-2a544cde2b83 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:20.689349 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d64a97b3-2f7f-4181-9a86-2a544cde2b83 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:20.690403 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d64a97b3-2f7f-4181-9a86-2a544cde2b83 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:20.691036 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d64a97b3-2f7f-4181-9a86-2a544cde2b83 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:20.946375 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-d64a97b3-2f7f-4181-9a86-2a544cde2b83 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:36:20.958378 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-d64a97b3-2f7f-4181-9a86-2a544cde2b83 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f" status: 200 len: 1576 microversion: 2.1 time: 0.286623 Feb 15 14:36:20.958970 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 505/1018] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:36:20 2022] GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f => generated 1576 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:36:21.547910 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-6a8fabae-fe59-448f-bde9-ade2dde35d6e req-332b3c74-53d8-467d-973f-932a38929fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "062d0093-cd36-49fd-8b0d-0d0029fc6d77", "tag": "74b413c9-27f5-42a4-a146-b9beb93af473"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:36:21.549480 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:36:21.549480 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:36:21.557532 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-6a8fabae-fe59-448f-bde9-ade2dde35d6e req-332b3c74-53d8-467d-973f-932a38929fb1 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:21.557979 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-6a8fabae-fe59-448f-bde9-ade2dde35d6e req-332b3c74-53d8-467d-973f-932a38929fb1 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:21.569684 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-6a8fabae-fe59-448f-bde9-ade2dde35d6e req-332b3c74-53d8-467d-973f-932a38929fb1 service nova] Creating event network-changed:74b413c9-27f5-42a4-a146-b9beb93af473 for instance 062d0093-cd36-49fd-8b0d-0d0029fc6d77 on hv-cinder-81914 Feb 15 14:36:21.574781 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-6a8fabae-fe59-448f-bde9-ade2dde35d6e req-332b3c74-53d8-467d-973f-932a38929fb1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090713 Feb 15 14:36:21.576186 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 514/1019] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:36:21.976082 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-12440869-6796-4955-b336-fd411853ea3a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:21.976849 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-12440869-6796-4955-b336-fd411853ea3a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: c4b3e2c3-075a-4d59-b6b1-c399c86de60f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:21.984190 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-12440869-6796-4955-b336-fd411853ea3a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:21.984960 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-12440869-6796-4955-b336-fd411853ea3a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:21.985840 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-12440869-6796-4955-b336-fd411853ea3a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:21.986356 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-12440869-6796-4955-b336-fd411853ea3a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:22.202379 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-12440869-6796-4955-b336-fd411853ea3a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:36:22.210756 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-12440869-6796-4955-b336-fd411853ea3a tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f" status: 200 len: 1458 microversion: 2.1 time: 0.238421 Feb 15 14:36:22.211618 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 506/1020] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:36:21 2022] GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f => generated 1458 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:36:23.094527 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-2dabaa50-8c25-4882-8993-17ae42f0c8eb req-db06969a-78d1-43f3-ae9f-e37165a33536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b3e2c3-075a-4d59-b6b1-c399c86de60f", "name": "network-vif-deleted", "tag": "b1fceff6-3d3d-4ab3-a0dc-f4e8cfeb62a8"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:36:23.097086 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:36:23.097086 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:36:23.106669 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-2dabaa50-8c25-4882-8993-17ae42f0c8eb req-db06969a-78d1-43f3-ae9f-e37165a33536 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:23.107210 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-2dabaa50-8c25-4882-8993-17ae42f0c8eb req-db06969a-78d1-43f3-ae9f-e37165a33536 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:23.120856 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-2dabaa50-8c25-4882-8993-17ae42f0c8eb req-db06969a-78d1-43f3-ae9f-e37165a33536 service nova] Creating event network-vif-deleted:b1fceff6-3d3d-4ab3-a0dc-f4e8cfeb62a8 for instance c4b3e2c3-075a-4d59-b6b1-c399c86de60f on hv-cinder-81914 Feb 15 14:36:23.127176 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-2dabaa50-8c25-4882-8993-17ae42f0c8eb req-db06969a-78d1-43f3-ae9f-e37165a33536 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038159 Feb 15 14:36:23.127980 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 515/1021] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:36:23.229012 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-82dd1449-cda6-48ba-b5a4-43ed014e7f7f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:23.229630 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-82dd1449-cda6-48ba-b5a4-43ed014e7f7f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: c4b3e2c3-075a-4d59-b6b1-c399c86de60f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:23.235951 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-82dd1449-cda6-48ba-b5a4-43ed014e7f7f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:23.236413 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-82dd1449-cda6-48ba-b5a4-43ed014e7f7f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:23.237208 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-82dd1449-cda6-48ba-b5a4-43ed014e7f7f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:23.237638 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-82dd1449-cda6-48ba-b5a4-43ed014e7f7f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:23.300922 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-82dd1449-cda6-48ba-b5a4-43ed014e7f7f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:36:23.310153 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-82dd1449-cda6-48ba-b5a4-43ed014e7f7f tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f" status: 200 len: 1224 microversion: 2.1 time: 0.084267 Feb 15 14:36:23.310637 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 507/1022] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:36:23 2022] GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:36:24.328633 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-4b3b65ea-3c57-4f91-a1d8-2ec08da1e524 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:24.329257 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-4b3b65ea-3c57-4f91-a1d8-2ec08da1e524 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: c4b3e2c3-075a-4d59-b6b1-c399c86de60f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:24.335492 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4b3b65ea-3c57-4f91-a1d8-2ec08da1e524 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:24.335942 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4b3b65ea-3c57-4f91-a1d8-2ec08da1e524 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:24.336745 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4b3b65ea-3c57-4f91-a1d8-2ec08da1e524 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:24.337218 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-4b3b65ea-3c57-4f91-a1d8-2ec08da1e524 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:24.349952 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.wsgi [None req-4b3b65ea-3c57-4f91-a1d8-2ec08da1e524 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] HTTP exception thrown: Instance c4b3e2c3-075a-4d59-b6b1-c399c86de60f could not be found. Feb 15 14:36:24.350534 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-4b3b65ea-3c57-4f91-a1d8-2ec08da1e524 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Returning 404 to user: Instance c4b3e2c3-075a-4d59-b6b1-c399c86de60f could not be found. {{(pid=116363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:36:24.351350 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-4b3b65ea-3c57-4f91-a1d8-2ec08da1e524 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f" status: 404 len: 111 microversion: 2.1 time: 0.027036 Feb 15 14:36:24.351880 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 516/1023] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:36:24 2022] GET /compute/v2.1/servers/c4b3e2c3-075a-4d59-b6b1-c399c86de60f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:36:27.681234 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-d3818428-ea38-4eca-bbea-a478db6b5c9c tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:27.681754 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-d3818428-ea38-4eca-bbea-a478db6b5c9c tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 9675ad13-9333-4efc-8f5d-2a22f16aa74f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:27.684089 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-78a2dbbc-2a60-47e6-8a83-22bc9dcf3f17 req-bc34ee06-64e7-46bd-af22-107566f12697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9675ad13-9333-4efc-8f5d-2a22f16aa74f", "tag": "53f4cc4e-a4dd-4cdd-87a5-4465c9f43dc1"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:36:27.686839 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:36:27.686839 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:36:27.688571 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d3818428-ea38-4eca-bbea-a478db6b5c9c tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:27.689031 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d3818428-ea38-4eca-bbea-a478db6b5c9c tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:27.689826 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d3818428-ea38-4eca-bbea-a478db6b5c9c tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:27.690264 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d3818428-ea38-4eca-bbea-a478db6b5c9c tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:27.695052 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-78a2dbbc-2a60-47e6-8a83-22bc9dcf3f17 req-bc34ee06-64e7-46bd-af22-107566f12697 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:27.695546 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-78a2dbbc-2a60-47e6-8a83-22bc9dcf3f17 req-bc34ee06-64e7-46bd-af22-107566f12697 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:27.708114 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-78a2dbbc-2a60-47e6-8a83-22bc9dcf3f17 req-bc34ee06-64e7-46bd-af22-107566f12697 service nova] Creating event network-changed:53f4cc4e-a4dd-4cdd-87a5-4465c9f43dc1 for instance 9675ad13-9333-4efc-8f5d-2a22f16aa74f on hv-cinder-81914 Feb 15 14:36:27.713674 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-78a2dbbc-2a60-47e6-8a83-22bc9dcf3f17 req-bc34ee06-64e7-46bd-af22-107566f12697 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033372 Feb 15 14:36:27.714869 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 517/1024] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:36:27.720901 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-d3818428-ea38-4eca-bbea-a478db6b5c9c tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 9675ad13-9333-4efc-8f5d-2a22f16aa74f] Going to try to terminate instance {{(pid=116362) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 14:36:27.805280 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-d3818428-ea38-4eca-bbea-a478db6b5c9c tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f" status: 204 len: 0 microversion: 2.1 time: 0.127308 Feb 15 14:36:27.806276 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 508/1025] 10.222.0.83 () {58 vars in 1238 bytes} [Tue Feb 15 14:36:27 2022] DELETE /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 14:36:27.816478 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-806d0a0d-4a89-4e1a-b701-ac492722cef4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:27.817234 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-806d0a0d-4a89-4e1a-b701-ac492722cef4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 9675ad13-9333-4efc-8f5d-2a22f16aa74f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:27.823833 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-806d0a0d-4a89-4e1a-b701-ac492722cef4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:27.824291 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-806d0a0d-4a89-4e1a-b701-ac492722cef4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:27.826521 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-806d0a0d-4a89-4e1a-b701-ac492722cef4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:27.826968 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-806d0a0d-4a89-4e1a-b701-ac492722cef4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:27.986989 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-806d0a0d-4a89-4e1a-b701-ac492722cef4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:36:27.995266 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-806d0a0d-4a89-4e1a-b701-ac492722cef4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f" status: 200 len: 1576 microversion: 2.1 time: 0.183283 Feb 15 14:36:27.995971 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 518/1026] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:36:27 2022] GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:36:29.013800 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-f2085136-074f-4f67-a9b2-bc64573aa512 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:29.014510 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-f2085136-074f-4f67-a9b2-bc64573aa512 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 9675ad13-9333-4efc-8f5d-2a22f16aa74f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:29.021076 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f2085136-074f-4f67-a9b2-bc64573aa512 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:29.021531 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f2085136-074f-4f67-a9b2-bc64573aa512 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:29.022313 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f2085136-074f-4f67-a9b2-bc64573aa512 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:29.022754 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-f2085136-074f-4f67-a9b2-bc64573aa512 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:29.160036 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-f2085136-074f-4f67-a9b2-bc64573aa512 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:36:29.167501 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-f2085136-074f-4f67-a9b2-bc64573aa512 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f" status: 200 len: 1458 microversion: 2.1 time: 0.158340 Feb 15 14:36:29.168069 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 509/1027] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:36:29 2022] GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f => generated 1458 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:36:30.068830 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [req-ad880811-b578-45b4-bc48-5b589257d6c4 req-ddc05aee-e84c-40d9-824f-ef696a95ef17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9675ad13-9333-4efc-8f5d-2a22f16aa74f", "name": "network-vif-deleted", "tag": "53f4cc4e-a4dd-4cdd-87a5-4465c9f43dc1"}]} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:36:30.070486 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:36:30.070486 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: warnings.warn(msg) Feb 15 14:36:30.078887 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-ad880811-b578-45b4-bc48-5b589257d6c4 req-ddc05aee-e84c-40d9-824f-ef696a95ef17 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:30.079327 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [req-ad880811-b578-45b4-bc48-5b589257d6c4 req-ddc05aee-e84c-40d9-824f-ef696a95ef17 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:30.090960 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.compute.server_external_events [req-ad880811-b578-45b4-bc48-5b589257d6c4 req-ddc05aee-e84c-40d9-824f-ef696a95ef17 service nova] Creating event network-vif-deleted:53f4cc4e-a4dd-4cdd-87a5-4465c9f43dc1 for instance 9675ad13-9333-4efc-8f5d-2a22f16aa74f on hv-cinder-81914 Feb 15 14:36:30.096281 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [req-ad880811-b578-45b4-bc48-5b589257d6c4 req-ddc05aee-e84c-40d9-824f-ef696a95ef17 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031304 Feb 15 14:36:30.097086 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 519/1028] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:36:30.189034 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-4e41a3b4-c13f-4858-8780-135c952373cf tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:30.189634 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-4e41a3b4-c13f-4858-8780-135c952373cf tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 9675ad13-9333-4efc-8f5d-2a22f16aa74f] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:30.196377 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4e41a3b4-c13f-4858-8780-135c952373cf tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:30.196856 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4e41a3b4-c13f-4858-8780-135c952373cf tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:30.197710 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4e41a3b4-c13f-4858-8780-135c952373cf tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:30.198144 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-4e41a3b4-c13f-4858-8780-135c952373cf tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:30.261313 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-4e41a3b4-c13f-4858-8780-135c952373cf tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a62058dca64450aa608973422ff9bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1601015ff4805a2884b047df84013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:36:30.269589 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-4e41a3b4-c13f-4858-8780-135c952373cf tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f" status: 200 len: 1224 microversion: 2.1 time: 0.086234 Feb 15 14:36:30.270524 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 510/1029] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:36:30 2022] GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:36:31.287836 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-7bc89754-f4e8-4856-8d5c-35dbc4a1cb96 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:31.288575 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-7bc89754-f4e8-4856-8d5c-35dbc4a1cb96 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 9675ad13-9333-4efc-8f5d-2a22f16aa74f] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:31.295302 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7bc89754-f4e8-4856-8d5c-35dbc4a1cb96 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:31.295753 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7bc89754-f4e8-4856-8d5c-35dbc4a1cb96 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:31.296559 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7bc89754-f4e8-4856-8d5c-35dbc4a1cb96 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:31.296998 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-7bc89754-f4e8-4856-8d5c-35dbc4a1cb96 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:31.310354 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.wsgi [None req-7bc89754-f4e8-4856-8d5c-35dbc4a1cb96 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] HTTP exception thrown: Instance 9675ad13-9333-4efc-8f5d-2a22f16aa74f could not be found. Feb 15 14:36:31.310928 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-7bc89754-f4e8-4856-8d5c-35dbc4a1cb96 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Returning 404 to user: Instance 9675ad13-9333-4efc-8f5d-2a22f16aa74f could not be found. {{(pid=116363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:36:31.311775 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-7bc89754-f4e8-4856-8d5c-35dbc4a1cb96 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f" status: 404 len: 111 microversion: 2.1 time: 0.028445 Feb 15 14:36:31.312292 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 520/1030] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:36:31 2022] GET /compute/v2.1/servers/9675ad13-9333-4efc-8f5d-2a22f16aa74f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:36:31.995195 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-3fd5ca5b-df2e-4a86-8005-702fa63d45a0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:31.995696 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-3fd5ca5b-df2e-4a86-8005-702fa63d45a0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 8808332d-30a8-493a-99cd-e95447b41793] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:32.002174 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3fd5ca5b-df2e-4a86-8005-702fa63d45a0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:32.002617 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3fd5ca5b-df2e-4a86-8005-702fa63d45a0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:32.003386 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3fd5ca5b-df2e-4a86-8005-702fa63d45a0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:32.003820 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3fd5ca5b-df2e-4a86-8005-702fa63d45a0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:32.020978 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.wsgi [None req-3fd5ca5b-df2e-4a86-8005-702fa63d45a0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] HTTP exception thrown: Instance 8808332d-30a8-493a-99cd-e95447b41793 could not be found. Feb 15 14:36:32.021566 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-3fd5ca5b-df2e-4a86-8005-702fa63d45a0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Returning 404 to user: Instance 8808332d-30a8-493a-99cd-e95447b41793 could not be found. {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:36:32.022397 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-3fd5ca5b-df2e-4a86-8005-702fa63d45a0 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "DELETE /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793" status: 404 len: 111 microversion: 2.1 time: 0.030940 Feb 15 14:36:32.022961 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 511/1031] 10.222.0.83 () {58 vars in 1238 bytes} [Tue Feb 15 14:36:31 2022] DELETE /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:36:32.031734 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-b39da7ef-ed24-40b6-9cb9-0b07d0ff43d4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:32.032341 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-b39da7ef-ed24-40b6-9cb9-0b07d0ff43d4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] [instance: 8808332d-30a8-493a-99cd-e95447b41793] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:36:32.038302 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b39da7ef-ed24-40b6-9cb9-0b07d0ff43d4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:32.038746 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b39da7ef-ed24-40b6-9cb9-0b07d0ff43d4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:32.039506 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b39da7ef-ed24-40b6-9cb9-0b07d0ff43d4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:36:32.039933 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b39da7ef-ed24-40b6-9cb9-0b07d0ff43d4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:36:32.052767 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.wsgi [None req-b39da7ef-ed24-40b6-9cb9-0b07d0ff43d4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] HTTP exception thrown: Instance 8808332d-30a8-493a-99cd-e95447b41793 could not be found. Feb 15 14:36:32.053335 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-b39da7ef-ed24-40b6-9cb9-0b07d0ff43d4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Returning 404 to user: Instance 8808332d-30a8-493a-99cd-e95447b41793 could not be found. {{(pid=116363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:36:32.054129 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-b39da7ef-ed24-40b6-9cb9-0b07d0ff43d4 tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793" status: 404 len: 111 microversion: 2.1 time: 0.026780 Feb 15 14:36:32.054642 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 521/1032] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:36:32 2022] GET /compute/v2.1/servers/8808332d-30a8-493a-99cd-e95447b41793 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:36:33.327476 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-ee7d9fd2-b14d-4bc9-8016-abf61ffcdefe tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] Calling method '.version_select at 0x7fd74f59ca60>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:36:33.347713 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-ee7d9fd2-b14d-4bc9-8016-abf61ffcdefe tempest-TestVolumeBootPattern-792206578 tempest-TestVolumeBootPattern-792206578-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-218978542" status: 202 len: 0 microversion: 2.1 time: 0.024220 Feb 15 14:36:33.348296 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 512/1033] 10.222.0.83 () {58 vars in 1259 bytes} [Tue Feb 15 14:36:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-218978542 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:38:18.325732 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-53f24aee-de5c-4785-9ccb-b7f3ff75b932 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:38:18.326294 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-53f24aee-de5c-4785-9ccb-b7f3ff75b932 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:18.332160 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-53f24aee-de5c-4785-9ccb-b7f3ff75b932 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:18.332643 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-53f24aee-de5c-4785-9ccb-b7f3ff75b932 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:18.333415 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-53f24aee-de5c-4785-9ccb-b7f3ff75b932 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:18.333854 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-53f24aee-de5c-4785-9ccb-b7f3ff75b932 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:18.357562 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.objects.instance [None req-53f24aee-de5c-4785-9ccb-b7f3ff75b932 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lazy-loading 'flavor' on Instance uuid 062d0093-cd36-49fd-8b0d-0d0029fc6d77 {{(pid=116363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:38:18.426562 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-53f24aee-de5c-4785-9ccb-b7f3ff75b932 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "POST /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77/action" status: 202 len: 0 microversion: 2.1 time: 0.105892 Feb 15 14:38:18.427133 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 522/1034] 10.222.0.83 () {60 vars in 1277 bytes} [Tue Feb 15 14:38:18 2022] POST /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:38:18.438521 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-5fbf16fa-3e1e-4fe6-8fd7-cecafe7c9fe1 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:38:18.439134 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-5fbf16fa-3e1e-4fe6-8fd7-cecafe7c9fe1 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:18.446358 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5fbf16fa-3e1e-4fe6-8fd7-cecafe7c9fe1 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:18.446988 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5fbf16fa-3e1e-4fe6-8fd7-cecafe7c9fe1 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:18.447956 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5fbf16fa-3e1e-4fe6-8fd7-cecafe7c9fe1 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:18.448608 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-5fbf16fa-3e1e-4fe6-8fd7-cecafe7c9fe1 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:18.592067 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-5fbf16fa-3e1e-4fe6-8fd7-cecafe7c9fe1 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:38:18.599392 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-5fbf16fa-3e1e-4fe6-8fd7-cecafe7c9fe1 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1568 microversion: 2.1 time: 0.168052 Feb 15 14:38:18.599954 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 513/1035] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:38:18 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:38:19.617717 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-943601c3-60fe-49dc-b0fb-03f7f5bc4cc5 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:38:19.618463 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-943601c3-60fe-49dc-b0fb-03f7f5bc4cc5 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:19.625039 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-943601c3-60fe-49dc-b0fb-03f7f5bc4cc5 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:19.625498 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-943601c3-60fe-49dc-b0fb-03f7f5bc4cc5 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:19.626271 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-943601c3-60fe-49dc-b0fb-03f7f5bc4cc5 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:19.626710 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-943601c3-60fe-49dc-b0fb-03f7f5bc4cc5 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:19.761806 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-943601c3-60fe-49dc-b0fb-03f7f5bc4cc5 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:38:19.769717 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-943601c3-60fe-49dc-b0fb-03f7f5bc4cc5 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1568 microversion: 2.1 time: 0.156791 Feb 15 14:38:19.770287 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 523/1036] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:38:19 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:38:20.787292 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-00fc66c2-b6bd-4b59-8bea-4c8d40c9426d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:38:20.787818 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-00fc66c2-b6bd-4b59-8bea-4c8d40c9426d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:20.794389 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-00fc66c2-b6bd-4b59-8bea-4c8d40c9426d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:20.794838 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-00fc66c2-b6bd-4b59-8bea-4c8d40c9426d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:20.795649 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-00fc66c2-b6bd-4b59-8bea-4c8d40c9426d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:20.796082 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-00fc66c2-b6bd-4b59-8bea-4c8d40c9426d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:20.929664 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-00fc66c2-b6bd-4b59-8bea-4c8d40c9426d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:38:20.937835 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-00fc66c2-b6bd-4b59-8bea-4c8d40c9426d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1568 microversion: 2.1 time: 0.154312 Feb 15 14:38:20.938391 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 514/1037] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:38:20 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:38:21.954720 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-023766ef-d6b7-4b54-b88f-9ee089203f2b tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:38:21.955335 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-023766ef-d6b7-4b54-b88f-9ee089203f2b tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:21.961714 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-023766ef-d6b7-4b54-b88f-9ee089203f2b tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:21.962161 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-023766ef-d6b7-4b54-b88f-9ee089203f2b tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:21.962930 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-023766ef-d6b7-4b54-b88f-9ee089203f2b tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:21.963366 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-023766ef-d6b7-4b54-b88f-9ee089203f2b tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:22.100738 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-023766ef-d6b7-4b54-b88f-9ee089203f2b tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:38:22.108179 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-023766ef-d6b7-4b54-b88f-9ee089203f2b tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1568 microversion: 2.1 time: 0.157144 Feb 15 14:38:22.108772 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 524/1038] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:38:21 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:38:23.126830 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-01d3b19a-4e99-4c54-8cbe-2ed616939aee tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:38:23.127377 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-01d3b19a-4e99-4c54-8cbe-2ed616939aee tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:23.134071 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-01d3b19a-4e99-4c54-8cbe-2ed616939aee tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:23.134451 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-01d3b19a-4e99-4c54-8cbe-2ed616939aee tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:23.135238 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-01d3b19a-4e99-4c54-8cbe-2ed616939aee tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:23.135668 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-01d3b19a-4e99-4c54-8cbe-2ed616939aee tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:23.275366 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-01d3b19a-4e99-4c54-8cbe-2ed616939aee tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:38:23.283495 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-01d3b19a-4e99-4c54-8cbe-2ed616939aee tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1568 microversion: 2.1 time: 0.162168 Feb 15 14:38:23.284435 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 515/1039] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:38:23 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:38:24.300992 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-0edf64d7-6705-43c6-9609-e9d428a4f563 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:38:24.301513 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-0edf64d7-6705-43c6-9609-e9d428a4f563 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:24.307540 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0edf64d7-6705-43c6-9609-e9d428a4f563 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:24.307993 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0edf64d7-6705-43c6-9609-e9d428a4f563 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:24.309598 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0edf64d7-6705-43c6-9609-e9d428a4f563 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:24.310428 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0edf64d7-6705-43c6-9609-e9d428a4f563 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:24.441699 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-0edf64d7-6705-43c6-9609-e9d428a4f563 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:38:24.449160 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-0edf64d7-6705-43c6-9609-e9d428a4f563 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1568 microversion: 2.1 time: 0.151979 Feb 15 14:38:24.450489 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 525/1040] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:38:24 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:38:25.467041 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-cdbce61f-90c7-4faf-9292-096d51cdc1f2 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:38:25.467688 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-cdbce61f-90c7-4faf-9292-096d51cdc1f2 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:25.473632 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cdbce61f-90c7-4faf-9292-096d51cdc1f2 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:25.474084 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cdbce61f-90c7-4faf-9292-096d51cdc1f2 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:25.474863 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cdbce61f-90c7-4faf-9292-096d51cdc1f2 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:25.475304 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cdbce61f-90c7-4faf-9292-096d51cdc1f2 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:25.613531 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-cdbce61f-90c7-4faf-9292-096d51cdc1f2 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:38:25.621112 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-cdbce61f-90c7-4faf-9292-096d51cdc1f2 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1568 microversion: 2.1 time: 0.158449 Feb 15 14:38:25.621772 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 516/1041] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:38:25 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:38:26.638627 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-3228fc22-aaba-4bbe-8b52-5d9decd13016 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:38:26.639240 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-3228fc22-aaba-4bbe-8b52-5d9decd13016 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:26.646002 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3228fc22-aaba-4bbe-8b52-5d9decd13016 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:26.646467 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3228fc22-aaba-4bbe-8b52-5d9decd13016 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:26.647247 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3228fc22-aaba-4bbe-8b52-5d9decd13016 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:26.647714 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-3228fc22-aaba-4bbe-8b52-5d9decd13016 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:26.787186 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-3228fc22-aaba-4bbe-8b52-5d9decd13016 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:38:26.794431 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-3228fc22-aaba-4bbe-8b52-5d9decd13016 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1568 microversion: 2.1 time: 0.160211 Feb 15 14:38:26.794989 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 526/1042] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:38:26 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:38:27.811319 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-3be68f53-9a21-4b4d-87f3-8fe7f06cdbc9 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:38:27.812003 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-3be68f53-9a21-4b4d-87f3-8fe7f06cdbc9 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:27.818176 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3be68f53-9a21-4b4d-87f3-8fe7f06cdbc9 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:27.818621 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3be68f53-9a21-4b4d-87f3-8fe7f06cdbc9 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:27.819392 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3be68f53-9a21-4b4d-87f3-8fe7f06cdbc9 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:27.819822 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-3be68f53-9a21-4b4d-87f3-8fe7f06cdbc9 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:27.956298 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-3be68f53-9a21-4b4d-87f3-8fe7f06cdbc9 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:38:27.963678 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-3be68f53-9a21-4b4d-87f3-8fe7f06cdbc9 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1568 microversion: 2.1 time: 0.156235 Feb 15 14:38:27.964281 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 517/1043] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:38:27 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:38:28.981923 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-325b26f8-120c-42ad-8bd0-387f2fdedc7b tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:38:28.982564 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-325b26f8-120c-42ad-8bd0-387f2fdedc7b tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:28.988958 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-325b26f8-120c-42ad-8bd0-387f2fdedc7b tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:28.989407 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-325b26f8-120c-42ad-8bd0-387f2fdedc7b tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:28.990194 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-325b26f8-120c-42ad-8bd0-387f2fdedc7b tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:28.990632 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-325b26f8-120c-42ad-8bd0-387f2fdedc7b tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:29.125864 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-325b26f8-120c-42ad-8bd0-387f2fdedc7b tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:38:29.134375 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-325b26f8-120c-42ad-8bd0-387f2fdedc7b tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1568 microversion: 2.1 time: 0.156718 Feb 15 14:38:29.134999 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 527/1044] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:38:28 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:38:30.152274 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-63a23294-67cf-4cff-aa62-05433c6ead40 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:38:30.153090 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-63a23294-67cf-4cff-aa62-05433c6ead40 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:30.159315 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-63a23294-67cf-4cff-aa62-05433c6ead40 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:30.159770 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-63a23294-67cf-4cff-aa62-05433c6ead40 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:30.160586 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-63a23294-67cf-4cff-aa62-05433c6ead40 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:30.161036 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-63a23294-67cf-4cff-aa62-05433c6ead40 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:30.294977 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-63a23294-67cf-4cff-aa62-05433c6ead40 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:38:30.302273 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-63a23294-67cf-4cff-aa62-05433c6ead40 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1568 microversion: 2.1 time: 0.153806 Feb 15 14:38:30.302837 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 518/1045] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:38:30 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:38:31.320150 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-b6d1929a-0738-492a-bec0-96bcb5e84416 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:38:31.320732 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-b6d1929a-0738-492a-bec0-96bcb5e84416 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:31.326993 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b6d1929a-0738-492a-bec0-96bcb5e84416 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:31.327442 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b6d1929a-0738-492a-bec0-96bcb5e84416 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:31.328217 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b6d1929a-0738-492a-bec0-96bcb5e84416 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:31.328689 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-b6d1929a-0738-492a-bec0-96bcb5e84416 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:31.475099 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-b6d1929a-0738-492a-bec0-96bcb5e84416 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:38:31.484019 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-b6d1929a-0738-492a-bec0-96bcb5e84416 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1569 microversion: 2.1 time: 0.167632 Feb 15 14:38:31.484623 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 528/1046] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:38:31 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:38:31.499950 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-7baea4bd-15ee-4b1d-b991-ece36d4afd68 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:38:31.500551 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-7baea4bd-15ee-4b1d-b991-ece36d4afd68 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:31.506799 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7baea4bd-15ee-4b1d-b991-ece36d4afd68 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:31.507246 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7baea4bd-15ee-4b1d-b991-ece36d4afd68 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:31.508017 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7baea4bd-15ee-4b1d-b991-ece36d4afd68 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:31.508478 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-7baea4bd-15ee-4b1d-b991-ece36d4afd68 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:31.704061 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7baea4bd-15ee-4b1d-b991-ece36d4afd68 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [e26fc338-6dca-4083-a738-d3455c520733] AMQP server on 10.222.0.83:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 15 14:38:32.712108 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO oslo.messaging._drivers.impl_rabbit [None req-7baea4bd-15ee-4b1d-b991-ece36d4afd68 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [e26fc338-6dca-4083-a738-d3455c520733] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 38192. Feb 15 14:38:32.715324 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-7baea4bd-15ee-4b1d-b991-ece36d4afd68 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "POST /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77/action" status: 202 len: 0 microversion: 2.1 time: 1.218932 Feb 15 14:38:32.715936 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 519/1047] 10.222.0.83 () {60 vars in 1277 bytes} [Tue Feb 15 14:38:31 2022] POST /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77/action => generated 0 bytes in 1220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:38:32.724572 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-5e57127e-0495-4479-ab78-93d2f4b91ee9 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:38:32.725160 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-5e57127e-0495-4479-ab78-93d2f4b91ee9 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:32.732139 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5e57127e-0495-4479-ab78-93d2f4b91ee9 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:32.732642 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5e57127e-0495-4479-ab78-93d2f4b91ee9 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:32.733439 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5e57127e-0495-4479-ab78-93d2f4b91ee9 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:32.733894 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-5e57127e-0495-4479-ab78-93d2f4b91ee9 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:32.878637 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-5e57127e-0495-4479-ab78-93d2f4b91ee9 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:38:32.886578 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-5e57127e-0495-4479-ab78-93d2f4b91ee9 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1517 microversion: 2.1 time: 0.165605 Feb 15 14:38:32.887481 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 529/1048] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:38:32 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:38:33.616541 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-2b35c133-ea15-4991-bad7-7e16e3346290 req-46cf1707-3680-4953-8ed1-c9786aa8ebbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "062d0093-cd36-49fd-8b0d-0d0029fc6d77", "name": "network-vif-unplugged", "status": "completed", "tag": "74b413c9-27f5-42a4-a146-b9beb93af473"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:38:33.618085 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:38:33.618085 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:38:33.626643 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-2b35c133-ea15-4991-bad7-7e16e3346290 req-46cf1707-3680-4953-8ed1-c9786aa8ebbf service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:33.627085 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-2b35c133-ea15-4991-bad7-7e16e3346290 req-46cf1707-3680-4953-8ed1-c9786aa8ebbf service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:33.638595 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.compute.server_external_events [req-2b35c133-ea15-4991-bad7-7e16e3346290 req-46cf1707-3680-4953-8ed1-c9786aa8ebbf service nova] Unable to find a host for instance 062d0093-cd36-49fd-8b0d-0d0029fc6d77. Dropping event network-vif-unplugged {{(pid=116362) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 15 14:38:33.639485 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-2b35c133-ea15-4991-bad7-7e16e3346290 req-46cf1707-3680-4953-8ed1-c9786aa8ebbf service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027267 Feb 15 14:38:33.640145 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 520/1049] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 15 14:38:33.904785 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-997816b7-78cd-47dc-9d2e-f63343adf3bf tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:38:33.905486 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-997816b7-78cd-47dc-9d2e-f63343adf3bf tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:33.912367 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-997816b7-78cd-47dc-9d2e-f63343adf3bf tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:33.912973 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-997816b7-78cd-47dc-9d2e-f63343adf3bf tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:33.913813 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-997816b7-78cd-47dc-9d2e-f63343adf3bf tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:33.914305 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-997816b7-78cd-47dc-9d2e-f63343adf3bf tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:34.058304 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-997816b7-78cd-47dc-9d2e-f63343adf3bf tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:38:34.065776 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-997816b7-78cd-47dc-9d2e-f63343adf3bf tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1519 microversion: 2.1 time: 0.165273 Feb 15 14:38:34.066339 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 530/1050] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:38:33 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:38:35.082875 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-2ffdfba5-45e8-4f7c-8c04-77708fd56335 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:38:35.083520 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-2ffdfba5-45e8-4f7c-8c04-77708fd56335 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:35.089826 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2ffdfba5-45e8-4f7c-8c04-77708fd56335 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:35.090380 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2ffdfba5-45e8-4f7c-8c04-77708fd56335 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:35.091167 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2ffdfba5-45e8-4f7c-8c04-77708fd56335 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:35.091607 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-2ffdfba5-45e8-4f7c-8c04-77708fd56335 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:35.291843 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-2ffdfba5-45e8-4f7c-8c04-77708fd56335 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:38:35.299971 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-2ffdfba5-45e8-4f7c-8c04-77708fd56335 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1575 microversion: 2.1 time: 0.220772 Feb 15 14:38:35.300597 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 521/1051] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:38:35 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1575 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:38:36.317054 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-266161ec-3373-42b7-a7b7-7f352d61d992 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:38:36.317608 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-266161ec-3373-42b7-a7b7-7f352d61d992 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:36.324060 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-266161ec-3373-42b7-a7b7-7f352d61d992 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:36.324815 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-266161ec-3373-42b7-a7b7-7f352d61d992 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:36.325595 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-266161ec-3373-42b7-a7b7-7f352d61d992 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:36.326031 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-266161ec-3373-42b7-a7b7-7f352d61d992 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:36.461616 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-266161ec-3373-42b7-a7b7-7f352d61d992 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:38:36.468918 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-266161ec-3373-42b7-a7b7-7f352d61d992 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1575 microversion: 2.1 time: 0.155658 Feb 15 14:38:36.469483 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 531/1052] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:38:36 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:38:37.485972 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-93b777ff-5608-46dd-99ad-e42bce78ad7d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:38:37.486603 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-93b777ff-5608-46dd-99ad-e42bce78ad7d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:37.493168 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-93b777ff-5608-46dd-99ad-e42bce78ad7d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:37.493666 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-93b777ff-5608-46dd-99ad-e42bce78ad7d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:37.494506 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-93b777ff-5608-46dd-99ad-e42bce78ad7d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:37.494946 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-93b777ff-5608-46dd-99ad-e42bce78ad7d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:37.634692 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-93b777ff-5608-46dd-99ad-e42bce78ad7d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:38:37.642819 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-93b777ff-5608-46dd-99ad-e42bce78ad7d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1575 microversion: 2.1 time: 0.160649 Feb 15 14:38:37.643387 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 522/1053] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:38:37 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:38:38.660060 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-0b358b53-8943-4289-bd00-487acb1ecf99 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:38:38.660708 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-0b358b53-8943-4289-bd00-487acb1ecf99 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:38.667078 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0b358b53-8943-4289-bd00-487acb1ecf99 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:38.667528 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0b358b53-8943-4289-bd00-487acb1ecf99 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:38.668844 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0b358b53-8943-4289-bd00-487acb1ecf99 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:38.669285 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0b358b53-8943-4289-bd00-487acb1ecf99 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:38.803206 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-0b358b53-8943-4289-bd00-487acb1ecf99 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:38:38.811525 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-0b358b53-8943-4289-bd00-487acb1ecf99 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1575 microversion: 2.1 time: 0.155149 Feb 15 14:38:38.812091 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 532/1054] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:38:38 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:38:39.828906 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-0f9688db-731f-4005-88c9-4b480a8b5544 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:38:39.829520 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-0f9688db-731f-4005-88c9-4b480a8b5544 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:39.835862 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0f9688db-731f-4005-88c9-4b480a8b5544 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:39.836305 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0f9688db-731f-4005-88c9-4b480a8b5544 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:39.837105 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0f9688db-731f-4005-88c9-4b480a8b5544 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:39.837545 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-0f9688db-731f-4005-88c9-4b480a8b5544 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:39.970985 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-0f9688db-731f-4005-88c9-4b480a8b5544 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:38:39.978320 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-0f9688db-731f-4005-88c9-4b480a8b5544 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1575 microversion: 2.1 time: 0.153955 Feb 15 14:38:39.978877 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 523/1055] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:38:39 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:38:40.995522 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-523ecda3-f248-4398-af41-8f6647a6f416 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:38:40.996194 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-523ecda3-f248-4398-af41-8f6647a6f416 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:41.002459 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-523ecda3-f248-4398-af41-8f6647a6f416 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:41.002902 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-523ecda3-f248-4398-af41-8f6647a6f416 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:41.003706 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-523ecda3-f248-4398-af41-8f6647a6f416 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:41.004140 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-523ecda3-f248-4398-af41-8f6647a6f416 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:41.144014 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-523ecda3-f248-4398-af41-8f6647a6f416 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:38:41.151708 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-523ecda3-f248-4398-af41-8f6647a6f416 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1575 microversion: 2.1 time: 0.159750 Feb 15 14:38:41.152650 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 533/1056] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:38:40 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:38:42.169851 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-cc0ea358-9bd1-42bc-8953-36ea3c79fe32 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:38:42.170394 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-cc0ea358-9bd1-42bc-8953-36ea3c79fe32 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:42.176592 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cc0ea358-9bd1-42bc-8953-36ea3c79fe32 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:42.177043 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cc0ea358-9bd1-42bc-8953-36ea3c79fe32 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:42.177834 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cc0ea358-9bd1-42bc-8953-36ea3c79fe32 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:42.178262 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-cc0ea358-9bd1-42bc-8953-36ea3c79fe32 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:42.314491 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-cc0ea358-9bd1-42bc-8953-36ea3c79fe32 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:38:42.321791 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-cc0ea358-9bd1-42bc-8953-36ea3c79fe32 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1575 microversion: 2.1 time: 0.156530 Feb 15 14:38:42.322363 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 524/1057] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:38:42 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:38:43.339753 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-95889964-e3c9-4d23-a52c-208cf2b3b938 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:38:43.340373 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-95889964-e3c9-4d23-a52c-208cf2b3b938 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:43.346721 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-95889964-e3c9-4d23-a52c-208cf2b3b938 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:43.347172 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-95889964-e3c9-4d23-a52c-208cf2b3b938 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:43.347945 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-95889964-e3c9-4d23-a52c-208cf2b3b938 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:43.348381 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-95889964-e3c9-4d23-a52c-208cf2b3b938 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:43.481349 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-95889964-e3c9-4d23-a52c-208cf2b3b938 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:38:43.488736 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-95889964-e3c9-4d23-a52c-208cf2b3b938 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1575 microversion: 2.1 time: 0.152666 Feb 15 14:38:43.489307 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 534/1058] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:38:43 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:38:43.694709 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-1ec2446c-68cc-4d03-b524-d66139500cec req-dca5d0e0-f637-4533-b586-5ce19eebc8eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "062d0093-cd36-49fd-8b0d-0d0029fc6d77", "name": "network-vif-plugged", "status": "completed", "tag": "74b413c9-27f5-42a4-a146-b9beb93af473"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:38:43.696126 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:38:43.696126 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:38:43.704607 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-1ec2446c-68cc-4d03-b524-d66139500cec req-dca5d0e0-f637-4533-b586-5ce19eebc8eb service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:43.705060 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-1ec2446c-68cc-4d03-b524-d66139500cec req-dca5d0e0-f637-4533-b586-5ce19eebc8eb service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:43.715958 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-1ec2446c-68cc-4d03-b524-d66139500cec req-dca5d0e0-f637-4533-b586-5ce19eebc8eb service nova] Creating event network-vif-plugged:74b413c9-27f5-42a4-a146-b9beb93af473 for instance 062d0093-cd36-49fd-8b0d-0d0029fc6d77 on hv-cinder-81914 Feb 15 14:38:43.719520 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: ERROR oslo.messaging._drivers.impl_rabbit [req-1ec2446c-68cc-4d03-b524-d66139500cec req-dca5d0e0-f637-4533-b586-5ce19eebc8eb service nova] [5fc5900e-8bc2-4fb6-bf6e-f8b5f2894d2a] AMQP server on 10.222.0.83:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 15 14:38:44.509877 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-36a48298-e66c-47fc-a0ee-1e650168aecb tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:38:44.510486 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-36a48298-e66c-47fc-a0ee-1e650168aecb tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:44.516822 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-36a48298-e66c-47fc-a0ee-1e650168aecb tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:44.517268 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-36a48298-e66c-47fc-a0ee-1e650168aecb tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:44.518035 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-36a48298-e66c-47fc-a0ee-1e650168aecb tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:44.518464 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-36a48298-e66c-47fc-a0ee-1e650168aecb tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:44.650018 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-36a48298-e66c-47fc-a0ee-1e650168aecb tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:38:44.658080 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-36a48298-e66c-47fc-a0ee-1e650168aecb tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1575 microversion: 2.1 time: 0.151858 Feb 15 14:38:44.658647 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 535/1059] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:38:44 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 14:38:44.726622 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO oslo.messaging._drivers.impl_rabbit [req-1ec2446c-68cc-4d03-b524-d66139500cec req-dca5d0e0-f637-4533-b586-5ce19eebc8eb service nova] [5fc5900e-8bc2-4fb6-bf6e-f8b5f2894d2a] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 38230. Feb 15 14:38:44.729819 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-1ec2446c-68cc-4d03-b524-d66139500cec req-dca5d0e0-f637-4533-b586-5ce19eebc8eb service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.038868 Feb 15 14:38:44.730700 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 525/1060] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:38:45.675011 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-0d16100d-6a6a-4cf5-9920-fa380ee3d03c tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:38:45.675665 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-0d16100d-6a6a-4cf5-9920-fa380ee3d03c tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:45.682164 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0d16100d-6a6a-4cf5-9920-fa380ee3d03c tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:45.682617 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0d16100d-6a6a-4cf5-9920-fa380ee3d03c tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:45.683402 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0d16100d-6a6a-4cf5-9920-fa380ee3d03c tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:45.683837 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-0d16100d-6a6a-4cf5-9920-fa380ee3d03c tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:45.819775 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-0d16100d-6a6a-4cf5-9920-fa380ee3d03c tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:38:45.828059 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-0d16100d-6a6a-4cf5-9920-fa380ee3d03c tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1575 microversion: 2.1 time: 0.156919 Feb 15 14:38:45.828658 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 536/1061] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:38:45 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:38:46.846110 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-b003c717-f791-4d97-b33a-eabd68a0bf67 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:38:46.846924 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-b003c717-f791-4d97-b33a-eabd68a0bf67 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:38:46.853135 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b003c717-f791-4d97-b33a-eabd68a0bf67 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:46.853588 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b003c717-f791-4d97-b33a-eabd68a0bf67 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:46.854368 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b003c717-f791-4d97-b33a-eabd68a0bf67 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:38:46.854807 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-b003c717-f791-4d97-b33a-eabd68a0bf67 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:38:46.992663 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-b003c717-f791-4d97-b33a-eabd68a0bf67 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:38:47.000770 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-b003c717-f791-4d97-b33a-eabd68a0bf67 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1562 microversion: 2.1 time: 0.159293 Feb 15 14:38:47.001361 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 526/1062] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:38:46 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:39:09.911781 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 14:39:09.912470 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: Tue Feb 15 14:39:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 14:39:17.178640 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 14:39:17.179192 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: Tue Feb 15 14:39:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 14:39:27.930289 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 14:39:27.930848 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: Tue Feb 15 14:39:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 14:39:57.584091 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-05a9bdc4-6bec-4190-9334-16d6d9a58b8d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:39:57.584743 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-05a9bdc4-6bec-4190-9334-16d6d9a58b8d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:39:57.585421 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-10ed5759-562b-426f-aced-41ffddf2261f req-d9b55670-551b-4d68-b104-940fb158e0ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "062d0093-cd36-49fd-8b0d-0d0029fc6d77", "tag": "74b413c9-27f5-42a4-a146-b9beb93af473"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:39:57.587208 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:39:57.587208 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:39:57.591595 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-05a9bdc4-6bec-4190-9334-16d6d9a58b8d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:39:57.592129 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-05a9bdc4-6bec-4190-9334-16d6d9a58b8d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:39:57.593015 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-05a9bdc4-6bec-4190-9334-16d6d9a58b8d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:39:57.593524 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-05a9bdc4-6bec-4190-9334-16d6d9a58b8d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:39:57.595274 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-10ed5759-562b-426f-aced-41ffddf2261f req-d9b55670-551b-4d68-b104-940fb158e0ee service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:39:57.595764 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-10ed5759-562b-426f-aced-41ffddf2261f req-d9b55670-551b-4d68-b104-940fb158e0ee service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:39:57.606978 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-10ed5759-562b-426f-aced-41ffddf2261f req-d9b55670-551b-4d68-b104-940fb158e0ee service nova] Creating event network-changed:74b413c9-27f5-42a4-a146-b9beb93af473 for instance 062d0093-cd36-49fd-8b0d-0d0029fc6d77 on hv-cinder-81914 Feb 15 14:39:57.612591 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-10ed5759-562b-426f-aced-41ffddf2261f req-d9b55670-551b-4d68-b104-940fb158e0ee service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031857 Feb 15 14:39:57.613814 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 527/1063] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 14:39:57.622500 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-05a9bdc4-6bec-4190-9334-16d6d9a58b8d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Going to try to terminate instance {{(pid=116363) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 14:39:57.703655 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-05a9bdc4-6bec-4190-9334-16d6d9a58b8d tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "DELETE /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 204 len: 0 microversion: 2.1 time: 0.124893 Feb 15 14:39:57.707522 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 537/1064] 10.222.0.83 () {58 vars in 1238 bytes} [Tue Feb 15 14:39:57 2022] DELETE /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 14:39:57.718092 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-d097373b-069c-47e0-a1c9-68fb1825853a tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:39:57.720826 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-d097373b-069c-47e0-a1c9-68fb1825853a tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:39:57.728137 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d097373b-069c-47e0-a1c9-68fb1825853a tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:39:57.728631 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d097373b-069c-47e0-a1c9-68fb1825853a tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:39:57.730786 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d097373b-069c-47e0-a1c9-68fb1825853a tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:39:57.731237 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-d097373b-069c-47e0-a1c9-68fb1825853a tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:39:58.021050 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.policy [None req-d097373b-069c-47e0-a1c9-68fb1825853a tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116362) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:39:58.029529 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-d097373b-069c-47e0-a1c9-68fb1825853a tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1568 microversion: 2.1 time: 0.318894 Feb 15 14:39:58.030101 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 528/1065] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:39:57 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1568 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:39:59.048034 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-c3e2acf2-2ac4-40c2-8d3c-880dcb16db79 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:39:59.048758 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-c3e2acf2-2ac4-40c2-8d3c-880dcb16db79 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:39:59.055027 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c3e2acf2-2ac4-40c2-8d3c-880dcb16db79 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:39:59.055468 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c3e2acf2-2ac4-40c2-8d3c-880dcb16db79 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:39:59.056232 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c3e2acf2-2ac4-40c2-8d3c-880dcb16db79 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:39:59.056701 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-c3e2acf2-2ac4-40c2-8d3c-880dcb16db79 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:39:59.247413 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-c3e2acf2-2ac4-40c2-8d3c-880dcb16db79 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:39:59.255189 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-c3e2acf2-2ac4-40c2-8d3c-880dcb16db79 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1449 microversion: 2.1 time: 0.211208 Feb 15 14:39:59.255807 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 538/1066] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:39:59 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1449 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:39:59.752731 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [req-5861a731-e389-472a-8e2d-78c795997546 req-e67a5725-d7c1-49d9-bc6a-16993880e953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "062d0093-cd36-49fd-8b0d-0d0029fc6d77", "name": "network-vif-deleted", "tag": "74b413c9-27f5-42a4-a146-b9beb93af473"}]} {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 14:39:59.754329 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 14:39:59.754329 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: warnings.warn(msg) Feb 15 14:39:59.762386 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-5861a731-e389-472a-8e2d-78c795997546 req-e67a5725-d7c1-49d9-bc6a-16993880e953 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:39:59.762835 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [req-5861a731-e389-472a-8e2d-78c795997546 req-e67a5725-d7c1-49d9-bc6a-16993880e953 service nova] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:39:59.774407 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.compute.server_external_events [req-5861a731-e389-472a-8e2d-78c795997546 req-e67a5725-d7c1-49d9-bc6a-16993880e953 service nova] Creating event network-vif-deleted:74b413c9-27f5-42a4-a146-b9beb93af473 for instance 062d0093-cd36-49fd-8b0d-0d0029fc6d77 on hv-cinder-81914 Feb 15 14:39:59.779897 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [req-5861a731-e389-472a-8e2d-78c795997546 req-e67a5725-d7c1-49d9-bc6a-16993880e953 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031163 Feb 15 14:39:59.780512 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 529/1067] 10.222.0.83 () {64 vars in 1317 bytes} [Tue Feb 15 14:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 14:40:00.272911 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-32439f2f-5be4-43bf-bef8-0ca166b88c80 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:40:00.273523 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.compute.api [None req-32439f2f-5be4-43bf-bef8-0ca166b88c80 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116363) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:40:00.280676 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-32439f2f-5be4-43bf-bef8-0ca166b88c80 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:40:00.281134 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-32439f2f-5be4-43bf-bef8-0ca166b88c80 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:40:00.281908 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-32439f2f-5be4-43bf-bef8-0ca166b88c80 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:40:00.282340 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-32439f2f-5be4-43bf-bef8-0ca166b88c80 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:40:00.314162 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-32439f2f-5be4-43bf-bef8-0ca166b88c80 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:40:00.314605 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG oslo_concurrency.lockutils [None req-32439f2f-5be4-43bf-bef8-0ca166b88c80 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:40:00.315042 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.objects.instance [None req-32439f2f-5be4-43bf-bef8-0ca166b88c80 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lazy-loading 'fault' on Instance uuid 062d0093-cd36-49fd-8b0d-0d0029fc6d77 {{(pid=116363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 14:40:00.357538 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.policy [None req-32439f2f-5be4-43bf-bef8-0ca166b88c80 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e47f21c8fa459292203942290e4eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bdb0c0982ff455995348e781d9728b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116363) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 14:40:00.364777 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-32439f2f-5be4-43bf-bef8-0ca166b88c80 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 200 len: 1224 microversion: 2.1 time: 0.095868 Feb 15 14:40:00.365332 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 539/1068] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:40:00 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 14:40:01.382886 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-c379a342-7c29-45a2-ac13-cf4b8b3b19c3 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '>' {{(pid=116362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:40:01.383630 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.compute.api [None req-c379a342-7c29-45a2-ac13-cf4b8b3b19c3 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] [instance: 062d0093-cd36-49fd-8b0d-0d0029fc6d77] Fetching instance by UUID {{(pid=116362) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 14:40:01.389904 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c379a342-7c29-45a2-ac13-cf4b8b3b19c3 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:40:01.390354 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c379a342-7c29-45a2-ac13-cf4b8b3b19c3 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:40:01.391133 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c379a342-7c29-45a2-ac13-cf4b8b3b19c3 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 14:40:01.391582 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG oslo_concurrency.lockutils [None req-c379a342-7c29-45a2-ac13-cf4b8b3b19c3 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Lock "f90dd206-7018-4083-9442-b93ea6e9dfe9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 14:40:01.405148 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.wsgi [None req-c379a342-7c29-45a2-ac13-cf4b8b3b19c3 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] HTTP exception thrown: Instance 062d0093-cd36-49fd-8b0d-0d0029fc6d77 could not be found. Feb 15 14:40:01.405734 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: DEBUG nova.api.openstack.wsgi [None req-c379a342-7c29-45a2-ac13-cf4b8b3b19c3 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Returning 404 to user: Instance 062d0093-cd36-49fd-8b0d-0d0029fc6d77 could not be found. {{(pid=116362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 14:40:01.406550 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO nova.api.openstack.requestlog [None req-c379a342-7c29-45a2-ac13-cf4b8b3b19c3 tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77" status: 404 len: 111 microversion: 2.1 time: 0.028233 Feb 15 14:40:01.407075 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: [pid: 116362|app: 0|req: 530/1069] 10.222.0.83 () {58 vars in 1235 bytes} [Tue Feb 15 14:40:01 2022] GET /compute/v2.1/servers/062d0093-cd36-49fd-8b0d-0d0029fc6d77 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 14:40:01.564598 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: DEBUG nova.api.openstack.wsgi [None req-fc1cc03c-4528-4e04-b657-21f48eef8c7f tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] Calling method '.version_select at 0x7fd75414b3a0>' {{(pid=116363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 14:40:01.586220 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO nova.api.openstack.requestlog [None req-fc1cc03c-4528-4e04-b657-21f48eef8c7f tempest-TestShelveInstance-1902416007 tempest-TestShelveInstance-1902416007-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-405284085" status: 202 len: 0 microversion: 2.1 time: 0.025183 Feb 15 14:40:01.586796 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: [pid: 116363|app: 0|req: 540/1070] 10.222.0.83 () {58 vars in 1250 bytes} [Tue Feb 15 14:40:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-405284085 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 14:42:29.919890 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 14:42:29.920388 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: Tue Feb 15 14:42:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 14:42:37.187582 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 14:42:37.188179 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: Tue Feb 15 14:42:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 14:42:47.938742 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 14:42:47.939336 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: Tue Feb 15 14:42:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 14:42:59.507758 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 14:42:59.508317 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: Tue Feb 15 14:42:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 14:43:01.921400 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 14:43:01.921826 dv-cinder-819149-3-iscsi devstack@n-api.service[116363]: Tue Feb 15 14:43:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 14:44:17.239115 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 14:44:17.239874 dv-cinder-819149-3-iscsi devstack@n-api.service[116362]: Tue Feb 15 14:44:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!